Aug 19 00:01:40 devstack cinder-volume[83178]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 19 00:01:40 devstack cinder-volume[83178]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 19 00:01:40 devstack cinder-volume[83178]: we strongly recommend against using it for new projects. Aug 19 00:01:40 devstack cinder-volume[83178]: If you are already using Eventlet, we recommend migrating to a different Aug 19 00:01:40 devstack cinder-volume[83178]: framework. For more detail see Aug 19 00:01:40 devstack cinder-volume[83178]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 19 00:01:40 devstack cinder-volume[83178]: import eventlet # noqa Aug 19 00:01:43 devstack cinder-volume[83178]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:01:43 devstack cinder-volume[83178]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:01:43 devstack cinder-volume[83178]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:01:44 devstack cinder-volume[83178]: INFO dbcounter [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Registered counter for database cinder Aug 19 00:01:44 devstack cinder-volume[83178]: DEBUG oslo_db.sqlalchemy.engines [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG dbcounter [-] [83178] Writer thread running {{(pid=83178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.rpc [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.rpc [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG oslo_db.sqlalchemy.engines [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.volume.manager [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Determined volume DB was empty at startup. Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG cinder.volume.manager [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83178) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.volume.manager [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 19 00:01:45 devstack cinder-volume[83178]: WARNING stevedore.named [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 19 00:01:45 devstack cinder-volume[83178]: WARNING castellan.key_manager [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:01:45 devstack cinder-volume[83178]: WARNING cinder.keymgr.conf_key_mgr [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG cinder.volume.drivers.lvm [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83178) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG oslo_concurrency.processutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG oslo_concurrency.processutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] CMD "cinder-rtstool verify" returned: 0 in 0.464s {{(pid=83178) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG oslo_db.sqlalchemy.engines [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.rpc [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.rpc [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 19 00:01:45 devstack cinder-volume[83178]: WARNING stevedore.named [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 19 00:01:45 devstack cinder-volume[83178]: WARNING castellan.key_manager [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:01:45 devstack cinder-volume[83178]: INFO cinder.volume.manager [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 19 00:01:45 devstack cinder-volume[83178]: DEBUG oslo_db.sqlalchemy.engines [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:01:46 devstack cinder-volume[83178]: INFO oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Starting 1 workers Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Started child 83330 {{(pid=83178) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Full set of CONF: {{(pid=83178) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] ******************************************************************************** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Configuration options gathered from: {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] ================================================================================ {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] allow_availability_zone_fallback = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] allow_compression_on_image_upload = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] allowed_direct_url_schemes = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] api_rate_limit = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] auth_strategy = keystone {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] az_cache_duration = 3600 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_availability_zone = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_host = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_stats_polling_interval = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83330]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backup_api_class = cinder.backup.api.API {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backup_name_template = backup-%s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backup_use_same_host = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backup_use_temp_snapshot = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] chap_password = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] chap_username = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_internal_tenant_project_id = 205fef47a3464f8a86ea0d83c866f10d {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_internal_tenant_user_id = 3f342f857aa9478f9992445c0d388c60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cloned_volume_same_az = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cluster = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] compression_format = gzip {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] compute_api_class = cinder.compute.nova.API {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] config_dir = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] config_source = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] control_exchange = openstack {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] debug = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] default_availability_zone = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] default_group_type = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] default_volume_type = lvmdriver-1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] disk_geometry = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] driver_client_cert = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] driver_client_cert_key = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] driver_data_namespace = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] driver_ssl_cert_path = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] driver_ssl_cert_verify = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] driver_use_ssl = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] enable_force_upload = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] enable_new_services = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] enable_unsupported_driver = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] enabled_backends = ['lvmdriver-1'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] enforce_multipath_for_image_xfer = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] filter_function = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_api_insecure = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_api_ssl_compression = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_ca_certificates_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_catalog_info = image:glance:publicURL {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_num_retries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance_request_timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] goodness_function = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] graceful_shutdown_timeout = 5 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] group_api_class = cinder.group.api.API {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] host = devstack {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_compress_on_upload = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_conversion_address_space_limit = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_conversion_cpu_limit = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_conversion_disable = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_upload_use_cinder_backend = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_upload_use_internal_tenant = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_volume_cache_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_volume_cache_max_count = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] image_volume_cache_max_size_gb = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] init_host_max_objects_retrieval = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] instance_format = [instance: %(uuid)s] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] iscsi_target_flags = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] iscsi_write_cache = on {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] iser_helper = tgtadm {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] iser_ip_address = 192.168.122.106 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] iser_port = 3260 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_color = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_config_append = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_dir = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_options = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_rotate_interval = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_rotate_interval_type = days {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] log_rotation_type = none {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] max_age = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] max_logfile_count = 30 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] max_logfile_size_mb = 200 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] max_over_subscription_ratio = 20.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] message_reap_interval = 86400 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] message_ttl = 2592000 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] migration_create_volume_timeout_secs = 300 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] monkey_patch = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] monkey_patch_modules = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] my_ip = 192.168.122.106 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] no_snapshot_gb_quota = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] num_iser_scan_tries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] num_shell_tries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] num_volume_device_scan_tries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] nvmeof_conn_info_version = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] nvmet_ns_id = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] nvmet_port_id = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_max_limit = 1000 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_volume_ext_list = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_volume_listen_port = 8776 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_volume_use_ssl = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] osapi_volume_workers = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] per_volume_size_limit = -1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] periodic_fuzzy_delay = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] periodic_interval = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] public_endpoint = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] publish_errors = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_backup_gigabytes = 1000 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_backups = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_gigabytes = 1000 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_groups = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_snapshots = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] quota_volumes = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] rate_limit_burst = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] rate_limit_except_level = CRITICAL {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] rate_limit_interval = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] reinit_driver_count = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] replication_device = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] report_discard_supported = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] report_interval = 120 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] reservation_clean_interval = 86400 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] reservation_expire = 86400 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] reserved_image_namespaces = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] reserved_percentage = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] rpc_response_timeout = 120 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] run_external_periodic_tasks = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] scst_target_driver = iscsi {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] scst_target_iqn_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_down_time = 720 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] shell_completion = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] snapshot_name_template = snapshot-%s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] snapshot_same_host = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] split_loggers = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] state_path = /opt/stack/data/cinder {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] storage_availability_zone = nova {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] storage_protocol = iSCSI {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] syslog_log_facility = LOG_USER {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] target_helper = lioadm {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] target_ip_address = 192.168.122.106 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] target_port = 3260 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] target_protocol = iscsi {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] target_secondary_ip_addresses = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] trace_flags = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] transport_url = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] until_refresh = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_chap_auth = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_default_quota_class = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_journal = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_json = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_multipath_for_image_xfer = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_stderr = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] use_syslog = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] verify_glance_signatures = enabled {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_api_class = cinder.volume.api.API {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_backend_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_clear = zero {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_clear_ionice = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_clear_size = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_copy_bps_limit = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_dd_blocksize = 1M {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_name_template = volume-%s {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_service_inithost_offload = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volume_usage_audit_period = month {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] zoning_mode = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_concurrency.disable_process_locking = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.auth_section = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.auth_type = password {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.auth_version = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.cache = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.include_service_catalog = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.insecure = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.interface = public {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_password = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcache_username = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.region_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.service_token_roles_required = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.service_type = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.backend = dogpile.cache.null {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.backend_argument = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.backend_expiration_time = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.config_prefix = cache.oslo {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.debug_cache_backend = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.enable_retry_client = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.enable_socket_keepalive = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.expiration_time = 600 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.hashclient_retry_attempts = 2 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_dead_retry = 300 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_pool_maxsize = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_sasl_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.password = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.proxies = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.redis_db = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.redis_server = localhost:6379 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.retry_attempts = 2 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.retry_delay = 0.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.socket_keepalive_count = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.socket_keepalive_idle = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.socket_keepalive_interval = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.socket_timeout = 1.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.tls_allowed_ciphers = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.tls_cafile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.tls_certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.tls_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.tls_keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cache.username = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] coordination.backend_url = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.asyncio_connection = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.asyncio_slave_connection = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.backend = sqlalchemy {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.connection = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.connection_debug = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.connection_parameters = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.connection_recycle_time = 3600 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.connection_trace = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.db_inc_retry_interval = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.db_max_retries = 20 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.db_max_retry_interval = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.db_retry_interval = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.max_overflow = 50 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.max_pool_size = 5 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.max_retries = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.mysql_wsrep_sync_wait = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.pool_timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.retry_interval = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.slave_connection = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.sqlite_synchronous = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.synchronous_reader = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] database.use_db_reconnect = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.connection_string = messaging:// {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.es_doc_type = notification {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.es_scroll_size = 10000 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.es_scroll_time = 2m {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.filter_error_trace = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.hmac_keys = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.sentinel_service_name = mymaster {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.socket_timeout = 0.1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.trace_requests = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler.trace_sqlalchemy = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler_jaeger.process_tags = {} {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler_jaeger.service_name_prefix = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] profiler_otlp.service_name_prefix = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.enforce_new_defaults = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.policy_default_rule = default {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.policy_file = policy.yaml {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.058s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.group = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.helper_command = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] privsep_osbrick.user = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.group = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.helper_command = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] cinder_sys_admin.user = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.auth_section = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.auth_type = password {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.cafile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.collect_timing = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.insecure = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.send_service_user_token = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.split_loggers = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] service_user.timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.auth_section = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.auth_type = password {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.collect_timing = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.insecure = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.region_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.split_loggers = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] glance.timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.backend_availability_zone = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.chap_password = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.chap_username = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.disk_geometry = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.driver_client_cert = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.driver_client_cert_key = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.driver_data_namespace = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.driver_use_ssl = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.extra_capabilities = {} {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.filter_function = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.goodness_function = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.iscsi_target_flags = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.iscsi_write_cache = on {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.iser_helper = tgtadm {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.iser_port = 3260 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.lvm_mirrors = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.lvm_share_target = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.lvm_type = auto {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.num_shell_tries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.replication_device = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.report_discard_supported = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.reserved_percentage = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.target_helper = tgtadm {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.target_port = 3260 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.target_protocol = iscsi {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.trace_flags = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.unique_fqdn_network = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.use_chap_auth = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_backend_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_clear = zero {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_clear_ionice = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_clear_size = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volume_group = cinder-volumes {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_reports.file_event_handler = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_reports.log_dir = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.backend_availability_zone = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.backend_host = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.chap_password = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.chap_username = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.chiscsi_conf = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.disk_geometry = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.driver_client_cert = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.driver_data_namespace = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.driver_use_ssl = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.extra_capabilities = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.filter_function = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.goodness_function = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.iser_helper = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.iser_ip_address = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.iser_port = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.iser_target_prefix = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.lvm_conf_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.lvm_mirrors = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.lvm_share_target = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.lvm_type = auto {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.num_shell_tries = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.nvmet_port_id = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.replication_device = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.report_discard_supported = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.reserved_percentage = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.scst_target_driver = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.storage_protocol = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.target_helper = lioadm {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.target_ip_address = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.target_port = 3260 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.target_protocol = iscsi {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.trace_flags = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.use_chap_auth = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_clear = zero {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_clear_size = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] lvmdriver-1.volumes_dir = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_notifications.driver = [] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_notifications.retry = -1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] key_manager.fixed_key = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.barbican_api_version = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.barbican_endpoint = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.barbican_endpoint_type = public {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.barbican_region_name = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.cafile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.collect_timing = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.insecure = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.number_of_retries = 60 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.retry_delay = 1 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.send_service_user_token = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.split_loggers = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.verify_ssl = True {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican.verify_ssl_path = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.auth_section = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.auth_type = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.cafile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.certfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.collect_timing = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.insecure = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.keyfile = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.split_loggers = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] barbican_service_user.timeout = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.approle_role_id = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.approle_secret_id = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.auth_method = approle {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.auth_path = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.kv_mountpoint = secret {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.kv_path = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.kv_version = 2 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.namespace = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.root_token_id = **** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.ssl_ca_crt_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.timeout = 60.0 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.token_file = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.token_role = None {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.use_ssl = False {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:01:46 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] ******************************************************************************** {{(pid=83178) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 19 00:01:46 devstack sudo[83338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 19 00:01:46 devstack sudo[83338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:46 devstack sudo[83338]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:46 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:46 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.276s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:01:46 devstack cinder-volume[83330]: INFO cinder.brick.local_dev.lvm [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:46 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:46 devstack sudo[83484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:01:46 devstack sudo[83484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:47 devstack sudo[83484]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG cinder.brick.local_dev.lvm [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83330) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:47 devstack sudo[83566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:47 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:47 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:47 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:47 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:47 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:47 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:48 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 19 00:01:48 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:48 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.315s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:48 devstack sudo[83948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:01:48 devstack sudo[83948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:48 devstack sudo[83948]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:48 devstack sudo[83951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:01:48 devstack sudo[83951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:48 devstack sudo[83951]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:48 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:48 devstack sudo[84009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:48 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:49 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:49 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:49 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:49 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:49 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:49 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:49 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:49 devstack cinder-volume[83330]: INFO cinder.volume.drivers.lvm [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:49 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:49 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:49 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:50 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG cinder.volume.drivers.lvm [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Updating volume stats {{(pid=83330) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:50 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:01:50 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:50 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:50 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:50 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:50 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:50 devstack sudo[84148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:50 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:50 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:50 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:50 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:50 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:51 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:51 devstack cinder-volume[83330]: INFO cinder.volume.driver [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Driver hasn't implemented _init_vendor_properties() Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG cinder.volume.driver [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83330) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_db.sqlalchemy.engines [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83330) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writer thread running {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG cinder.db.api [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Building query based on filter {{(pid=83330) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG cinder.image.image_utils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83330) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 19 00:01:51 devstack cinder-volume[83330]: INFO cinder.keymgr.migration [None req-df9d7b7b-fc93-45bb-81a4-faa48945f992 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG cinder.volume.drivers.lvm [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Updating volume stats {{(pid=83330) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:51 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:01:51 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:51 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:51 devstack sudo[84157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:51 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:51 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:51 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:51 devstack sudo[84162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:51 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:52 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:52 devstack sudo[84166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:52 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:52 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG cinder.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Notifying Schedulers of capabilities ... {{(pid=83330) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:01:52 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Driver initialization completed successfully. Aug 19 00:01:52 devstack cinder-volume[83330]: INFO cinder.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Initiating service 2 cleanup Aug 19 00:01:52 devstack cinder-volume[83330]: INFO cinder.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Service 2 cleanup completed. Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG cinder.service [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Creating RPC server for service cinder-volume {{(pid=83330) start /opt/stack/cinder/cinder/service.py:231}} Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG cinder.service [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83330) start /opt/stack/cinder/cinder/service.py:237}} Aug 19 00:01:52 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG cinder.volume.drivers.lvm [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Updating volume stats {{(pid=83330) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:52 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:01:52 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:52 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:52 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:52 devstack sudo[84174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:52 devstack sudo[84174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:53 devstack sudo[84174]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:53 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:53 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:53 devstack sudo[84180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:01:53 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:53 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:53 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:53 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:01:53 devstack sudo[84183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:01:53 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:01:53 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root Aug 19 00:01:53 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:01:53 devstack cinder-volume[83330]: INFO cinder.volume.manager [None req-def623d5-ae65-4703-9f5a-7fe56754a7e8 None None] Driver post RPC initialization completed successfully. Aug 19 00:01:56 devstack cinder-volume[83178]: DEBUG dbcounter [-] [83178] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83178) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:02:02 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:02:03 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:02:22 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager._thread_info {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:02:22 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread count: 6 {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:02:22 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread info: [<_MainThread(MainThread, started 125209937694848)>, , , , , ] {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:03:22 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:03:22 devstack cinder-volume[83330]: DEBUG cinder.volume.drivers.lvm [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Updating volume stats {{(pid=83330) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 19 00:03:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:03:22 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:03:22 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:03:22 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Aug 19 00:03:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:03:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:03:22 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:03:22 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:03:23 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:03:23 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:03:23 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:03:23 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:03:23 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:03:23 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:03:23 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG cinder.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Notifying Schedulers of capabilities ... {{(pid=83330) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager._thread_info {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread count: 6 {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:03:23 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread info: [<_MainThread(MainThread, started 125209937694848)>, , , , , ] {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:04:03 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writing DB stats cinder:SELECT=1 {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:04:03 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writing DB stats cinder:UPDATE=1 {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:04:22 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:04:22 devstack cinder-volume[83330]: DEBUG cinder.volume.drivers.lvm [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Updating volume stats {{(pid=83330) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 19 00:04:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:04:22 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:04:22 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:04:22 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Aug 19 00:04:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:04:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:04:22 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:04:22 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:04:23 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:04:23 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:04:23 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:04:23 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:04:23 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:04:23 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:04:23 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG cinder.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Notifying Schedulers of capabilities ... {{(pid=83330) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager._thread_info {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread count: 6 {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:04:23 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread info: [<_MainThread(MainThread, started 125209937694848)>, , , , , ] {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:05:22 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:05:22 devstack cinder-volume[83330]: DEBUG cinder.volume.drivers.lvm [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Updating volume stats {{(pid=83330) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 19 00:05:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:05:22 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 19 00:05:22 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:05:22 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Aug 19 00:05:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:05:22 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:05:22 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:05:22 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:05:23 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:05:23 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 19 00:05:23 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:05:23 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:05:23 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 19 00:05:23 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:05:23 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG oslo_concurrency.processutils [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83330) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG cinder.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Notifying Schedulers of capabilities ... {{(pid=83330) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG oslo_service.periodic_task [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] Running periodic task VolumeManager._thread_info {{(pid=83330) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread count: 6 {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:05:23 devstack cinder-volume[83330]: DEBUG cinder.volume.manager [None req-a98c4bfe-9e1a-4036-8257-95664eb94318 None None] thread info: [<_MainThread(MainThread, started 125209937694848)>, , , , , ] {{(pid=83330) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:06:03 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writing DB stats cinder:SELECT=1 {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:06:03 devstack cinder-volume[83330]: DEBUG dbcounter [-] [83330] Writing DB stats cinder:UPDATE=1 {{(pid=83330) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:06:14 devstack cinder-volume[83178]: INFO oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Caught SIGTERM, stopping children Aug 19 00:06:14 devstack cinder-volume[83178]: DEBUG oslo_concurrency.lockutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Acquiring lock "singleton_lock" {{(pid=83178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:06:14 devstack cinder-volume[83178]: DEBUG oslo_concurrency.lockutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Acquired lock "singleton_lock" {{(pid=83178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:06:14 devstack cinder-volume[83178]: DEBUG oslo_concurrency.lockutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Releasing lock "singleton_lock" {{(pid=83178) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:06:14 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Stop services. {{(pid=83178) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 19 00:06:14 devstack cinder-volume[83178]: DEBUG oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Killing children. {{(pid=83178) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 19 00:06:14 devstack cinder-volume[83178]: INFO oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Waiting on 1 children to exit Aug 19 00:06:17 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Acquiring lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:06:17 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Acquired lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:06:17 devstack cinder-volume[83330]: DEBUG oslo_concurrency.lockutils [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Releasing lock "singleton_lock" {{(pid=83330) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:06:17 devstack cinder-volume[83330]: WARNING amqp [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 19 00:06:17 devstack cinder-volume[83330]: WARNING amqp [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 19 00:06:17 devstack cinder-volume[83178]: INFO oslo_service.backend._eventlet.service [None req-c74c61fb-3f12-4c34-952c-2423cbb38211 None None] Child 83330 exited with status 0 Aug 19 00:06:17 devstack cinder-volume[93435]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 19 00:06:17 devstack cinder-volume[93435]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 19 00:06:17 devstack cinder-volume[93435]: we strongly recommend against using it for new projects. Aug 19 00:06:17 devstack cinder-volume[93435]: If you are already using Eventlet, we recommend migrating to a different Aug 19 00:06:17 devstack cinder-volume[93435]: framework. For more detail see Aug 19 00:06:17 devstack cinder-volume[93435]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 19 00:06:17 devstack cinder-volume[93435]: import eventlet # noqa Aug 19 00:06:19 devstack cinder-volume[93435]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:06:19 devstack cinder-volume[93435]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:06:19 devstack cinder-volume[93435]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:06:20 devstack cinder-volume[93435]: INFO dbcounter [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Registered counter for database cinder Aug 19 00:06:20 devstack cinder-volume[93435]: DEBUG oslo_db.sqlalchemy.engines [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:20 devstack cinder-volume[93435]: DEBUG dbcounter [-] [93435] Writer thread running {{(pid=93435) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 19 00:06:20 devstack cinder-volume[93435]: INFO cinder.rpc [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 19 00:06:20 devstack cinder-volume[93435]: INFO cinder.rpc [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 19 00:06:20 devstack cinder-volume[93435]: DEBUG oslo_db.sqlalchemy.engines [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:20 devstack cinder-volume[93435]: INFO cinder.volume.manager [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Determined volume DB was empty at startup. Aug 19 00:06:20 devstack cinder-volume[93435]: DEBUG cinder.volume.manager [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93435) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 19 00:06:20 devstack cinder-volume[93435]: INFO cinder.volume.manager [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 19 00:06:20 devstack cinder-volume[93435]: WARNING stevedore.named [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 19 00:06:20 devstack cinder-volume[93435]: WARNING castellan.key_manager [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:06:20 devstack cinder-volume[93435]: WARNING cinder.keymgr.conf_key_mgr [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:06:21 devstack cinder-volume[93435]: INFO cinder.volume.manager [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_db.sqlalchemy.engines [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93435) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:21 devstack cinder-volume[93435]: INFO oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Starting 1 workers Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Started child 93658 {{(pid=93435) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Full set of CONF: {{(pid=93435) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] ******************************************************************************** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Configuration options gathered from: {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] ================================================================================ {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] allow_availability_zone_fallback = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] allow_compression_on_image_upload = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] allowed_direct_url_schemes = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] api_rate_limit = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] auth_strategy = keystone {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_availability_zone = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_host = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_stats_polling_interval = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backup_api_class = cinder.backup.api.API {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backup_name_template = backup-%s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backup_use_same_host = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backup_use_temp_snapshot = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] chap_password = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] chap_username = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_internal_tenant_project_id = 205fef47a3464f8a86ea0d83c866f10d {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_internal_tenant_user_id = 3f342f857aa9478f9992445c0d388c60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cluster = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] compression_format = gzip {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] compute_api_class = cinder.compute.nova.API {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] config_dir = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] config_source = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] control_exchange = openstack {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] debug = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] default_availability_zone = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] default_group_type = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] default_volume_type = QuobyteHD {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] disk_geometry = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] driver_client_cert = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] driver_client_cert_key = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] driver_data_namespace = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] driver_ssl_cert_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] driver_ssl_cert_verify = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] driver_use_ssl = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] enable_new_services = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] enable_unsupported_driver = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] enabled_backends = ['QuobyteHD'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] enforce_multipath_for_image_xfer = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] filter_function = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_api_insecure = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_api_ssl_compression = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_ca_certificates_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_catalog_info = image:glance:publicURL {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_num_retries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance_request_timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] goodness_function = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] graceful_shutdown_timeout = 5 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] group_api_class = cinder.group.api.API {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] host = devstack {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_compress_on_upload = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_conversion_address_space_limit = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_conversion_cpu_limit = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_conversion_disable = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_upload_use_cinder_backend = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_upload_use_internal_tenant = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_volume_cache_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_volume_cache_max_count = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] image_volume_cache_max_size_gb = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] init_host_max_objects_retrieval = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] instance_format = [instance: %(uuid)s] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93658]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] iscsi_target_flags = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] iscsi_write_cache = on {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] iser_helper = tgtadm {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] iser_ip_address = 192.168.122.106 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] iser_port = 3260 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_color = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_config_append = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_dir = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_options = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_rotate_interval = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_rotate_interval_type = days {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] log_rotation_type = none {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] max_age = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] max_logfile_count = 30 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] max_logfile_size_mb = 200 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] max_over_subscription_ratio = 20.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] message_reap_interval = 86400 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] message_ttl = 2592000 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] migration_create_volume_timeout_secs = 300 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] monkey_patch = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] monkey_patch_modules = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] my_ip = 192.168.122.106 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] no_snapshot_gb_quota = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] num_iser_scan_tries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] num_shell_tries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] num_volume_device_scan_tries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] nvmeof_conn_info_version = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] nvmet_ns_id = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] nvmet_port_id = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_max_limit = 1000 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_volume_ext_list = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_volume_listen_port = 8776 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_volume_use_ssl = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] osapi_volume_workers = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] per_volume_size_limit = -1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] periodic_fuzzy_delay = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] periodic_interval = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] public_endpoint = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] publish_errors = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_backup_gigabytes = 1000 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_backups = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_gigabytes = 1000 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_groups = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_snapshots = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] quota_volumes = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] rate_limit_burst = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] rate_limit_except_level = CRITICAL {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] rate_limit_interval = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] reinit_driver_count = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] replication_device = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] report_discard_supported = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] report_interval = 120 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] reservation_clean_interval = 86400 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] reservation_expire = 86400 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] reserved_image_namespaces = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] reserved_percentage = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] rpc_response_timeout = 120 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] run_external_periodic_tasks = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] scst_target_driver = iscsi {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] scst_target_iqn_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_down_time = 720 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] shell_completion = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] snapshot_name_template = snapshot-%s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] split_loggers = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] state_path = /opt/stack/data/cinder {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] storage_availability_zone = nova {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] storage_protocol = iSCSI {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] syslog_log_facility = LOG_USER {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] target_helper = lioadm {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] target_ip_address = 192.168.122.106 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] target_port = 3260 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] target_protocol = iscsi {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] target_secondary_ip_addresses = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] trace_flags = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] transport_url = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] until_refresh = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_chap_auth = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_default_quota_class = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_journal = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_json = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_multipath_for_image_xfer = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_stderr = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] use_syslog = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] verify_glance_signatures = enabled {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_api_class = cinder.volume.api.API {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_backend_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_clear = zero {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_clear_ionice = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_clear_size = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_copy_bps_limit = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_dd_blocksize = 1M {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_name_template = volume-%s {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_service_inithost_offload = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volume_usage_audit_period = month {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] zoning_mode = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_concurrency.disable_process_locking = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.auth_section = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.auth_type = password {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.auth_version = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.cache = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.include_service_catalog = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.insecure = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.interface = public {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_password = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcache_username = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.region_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.service_type = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.backend = dogpile.cache.null {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.backend_argument = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.backend_expiration_time = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.config_prefix = cache.oslo {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.debug_cache_backend = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.enable_retry_client = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.enable_socket_keepalive = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.expiration_time = 600 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.hashclient_retry_attempts = 2 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_dead_retry = 300 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_pool_maxsize = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_sasl_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.password = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.proxies = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.redis_db = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.redis_server = localhost:6379 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.retry_attempts = 2 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.retry_delay = 0.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.socket_keepalive_count = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.socket_keepalive_idle = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.socket_keepalive_interval = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.socket_timeout = 1.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.tls_allowed_ciphers = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.tls_cafile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.tls_certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.tls_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.tls_keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cache.username = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] coordination.backend_url = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.asyncio_connection = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.asyncio_slave_connection = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.backend = sqlalchemy {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.connection = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.connection_debug = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.connection_parameters = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.connection_recycle_time = 3600 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.connection_trace = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.db_inc_retry_interval = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.db_max_retries = 20 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.db_max_retry_interval = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.db_retry_interval = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.max_overflow = 50 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.max_pool_size = 5 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.max_retries = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.mysql_wsrep_sync_wait = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.pool_timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.retry_interval = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.slave_connection = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.sqlite_synchronous = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.synchronous_reader = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] database.use_db_reconnect = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93658]: INFO cinder.volume.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Starting volume driver QuobyteDriver (1.2) Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.remotefs [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93658) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.connection_string = messaging:// {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.es_doc_type = notification {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.es_scroll_size = 10000 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.es_scroll_time = 2m {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.filter_error_trace = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.hmac_keys = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.sentinel_service_name = mymaster {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.socket_timeout = 0.1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.trace_requests = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler.trace_sqlalchemy = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler_jaeger.process_tags = {} {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler_jaeger.service_name_prefix = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] profiler_otlp.service_name_prefix = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.enforce_new_defaults = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.policy_default_rule = default {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.policy_file = policy.yaml {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.group = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.helper_command = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] privsep_osbrick.user = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.group = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.helper_command = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] cinder_sys_admin.user = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.auth_section = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.auth_type = password {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.cafile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.collect_timing = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.insecure = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.send_service_user_token = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.split_loggers = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] service_user.timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.auth_section = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.auth_type = password {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.collect_timing = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.insecure = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.region_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.split_loggers = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] glance.timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.backend_availability_zone = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.chap_password = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.chap_username = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.disk_geometry = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.driver_client_cert = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.driver_client_cert_key = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.driver_data_namespace = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.driver_use_ssl = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.extra_capabilities = {} {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.filter_function = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.goodness_function = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.iscsi_target_flags = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.iscsi_write_cache = on {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.iser_helper = tgtadm {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.iser_port = 3260 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_host = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_login = admin {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_mount_options = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_password = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_private_key = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_share_path = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.num_shell_tries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.quobyte_volume_url = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.replication_device = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.report_discard_supported = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.reserved_percentage = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.target_helper = tgtadm {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.target_port = 3260 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.target_protocol = iscsi {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.trace_flags = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.unique_fqdn_network = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.use_chap_auth = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_backend_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_clear = zero {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_clear_ionice = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_clear_size = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_reports.file_event_handler = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_reports.log_dir = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.backend_availability_zone = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.backend_host = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.chap_password = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.chap_username = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.chiscsi_conf = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.disk_geometry = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.driver_client_cert = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.driver_data_namespace = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.driver_use_ssl = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.extra_capabilities = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.filter_function = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.goodness_function = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.iser_helper = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.iser_ip_address = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.iser_port = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.iser_target_prefix = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_host = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_login = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_mount_options = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_password = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_private_key = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_share_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_ssh_port = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.num_shell_tries = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.nvmet_port_id = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.replication_device = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.report_discard_supported = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.reserved_percentage = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.scst_target_driver = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.storage_protocol = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.target_helper = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.target_ip_address = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.target_port = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.target_prefix = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.target_protocol = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.trace_flags = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.use_chap_auth = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_clear = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_clear_size = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] QuobyteHD.volumes_dir = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_notifications.driver = [] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_notifications.retry = -1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] key_manager.fixed_key = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.barbican_api_version = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.barbican_endpoint = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.barbican_endpoint_type = public {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.barbican_region_name = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.cafile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93658) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 19 00:06:21 devstack cinder-volume[93658]: WARNING cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.collect_timing = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.insecure = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.number_of_retries = 60 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.retry_delay = 1 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.send_service_user_token = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.split_loggers = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93658]: WARNING cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.verify_ssl = True {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Running cmd (subprocess): mount.quobyte {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican.verify_ssl_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.auth_section = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.auth_type = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.cafile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.certfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.collect_timing = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.insecure = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.keyfile = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.split_loggers = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] barbican_service_user.timeout = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.approle_role_id = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.approle_secret_id = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.auth_method = approle {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.auth_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.kv_mountpoint = secret {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.kv_path = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.kv_version = 2 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.namespace = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.root_token_id = **** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.ssl_ca_crt_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.timeout = 60.0 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.token_file = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.token_role = None {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.use_ssl = False {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:21 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] ******************************************************************************** {{(pid=93435) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 19 00:06:21 devstack quobyte-client[93659]: Reading configuration file: /etc/quobyte/client.cfg Aug 19 00:06:21 devstack quobyte-client[93659]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=93658) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:21 devstack cinder-volume[93658]: INFO cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 ... Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 -c /etc/quobyte/client-cinder.cfg {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:21 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 -c /etc/quobyte/client-cinder.cfg Aug 19 00:06:21 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:21 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.381s {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:21 devstack cinder-volume[93658]: INFO cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 succeeded Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=93658) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.395s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:21 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:21 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:21 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:22 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.251s {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:22 devstack cinder-volume[93658]: INFO cinder.volume.driver [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Driver hasn't implemented _init_vendor_properties() Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.volume.driver [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953582763672, 'free_capacity_gb': 1775.6953582763672, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93658) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_db.sqlalchemy.engines [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93658) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG dbcounter [-] [93658] Writer thread running {{(pid=93658) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.db.api [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Building query based on filter {{(pid=93658) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.image.image_utils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93658) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 19 00:06:22 devstack cinder-volume[93658]: INFO cinder.keymgr.migration [None req-09b3e74b-6474-42c8-8ee3-cf642dda141b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=93658) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=93658) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:22 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:22 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:22 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.238s {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Notifying Schedulers of capabilities ... {{(pid=93658) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:06:22 devstack cinder-volume[93658]: INFO cinder.volume.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Driver initialization completed successfully. Aug 19 00:06:22 devstack cinder-volume[93658]: INFO cinder.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Initiating service 3 cleanup Aug 19 00:06:22 devstack cinder-volume[93658]: INFO cinder.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Service 3 cleanup completed. Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.service [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Creating RPC server for service cinder-volume {{(pid=93658) start /opt/stack/cinder/cinder/service.py:231}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.service [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93658) start /opt/stack/cinder/cinder/service.py:237}} Aug 19 00:06:22 devstack cinder-volume[93658]: INFO cinder.volume.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=93658) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=93658) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:22 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:22 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:22 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:23 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:23 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.244s {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:23 devstack cinder-volume[93658]: INFO cinder.volume.manager [None req-63597ec2-6803-4e19-8c9e-e32adf36b7af None None] Driver post RPC initialization completed successfully. Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=93658) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG cinder.volume.drivers.quobyte [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=93658) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93658) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:27 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:27 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:27 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG oslo_concurrency.processutils [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.230s {{(pid=93658) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:27 devstack cinder-volume[93658]: DEBUG cinder.manager [None req-c0914cca-46fc-4f5b-9d6c-4679f1f56ac6 None None] Notifying Schedulers of capabilities ... {{(pid=93658) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:06:28 devstack cinder-volume[93435]: INFO oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Caught SIGTERM, stopping children Aug 19 00:06:28 devstack cinder-volume[93435]: DEBUG oslo_concurrency.lockutils [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Acquiring lock "singleton_lock" {{(pid=93435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:06:28 devstack cinder-volume[93435]: DEBUG oslo_concurrency.lockutils [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Acquired lock "singleton_lock" {{(pid=93435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:06:28 devstack cinder-volume[93435]: DEBUG oslo_concurrency.lockutils [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Releasing lock "singleton_lock" {{(pid=93435) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:06:28 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Stop services. {{(pid=93435) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 19 00:06:28 devstack cinder-volume[93435]: DEBUG oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Killing children. {{(pid=93435) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 19 00:06:28 devstack cinder-volume[93435]: INFO oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Waiting on 1 children to exit Aug 19 00:06:31 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Acquiring lock "singleton_lock" {{(pid=93658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:06:31 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Acquired lock "singleton_lock" {{(pid=93658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:06:31 devstack cinder-volume[93658]: DEBUG oslo_concurrency.lockutils [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Releasing lock "singleton_lock" {{(pid=93658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:06:31 devstack cinder-volume[93658]: WARNING amqp [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 19 00:06:31 devstack cinder-volume[93658]: WARNING amqp [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 19 00:06:31 devstack cinder-volume[93435]: INFO oslo_service.backend._eventlet.service [None req-ea79916e-a383-4f20-8f55-77c87f203967 None None] Child 93658 exited with status 0 Aug 19 00:06:31 devstack cinder-volume[93949]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 19 00:06:31 devstack cinder-volume[93949]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 19 00:06:31 devstack cinder-volume[93949]: we strongly recommend against using it for new projects. Aug 19 00:06:31 devstack cinder-volume[93949]: If you are already using Eventlet, we recommend migrating to a different Aug 19 00:06:31 devstack cinder-volume[93949]: framework. For more detail see Aug 19 00:06:31 devstack cinder-volume[93949]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 19 00:06:31 devstack cinder-volume[93949]: import eventlet # noqa Aug 19 00:06:34 devstack cinder-volume[93949]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 19 00:06:34 devstack cinder-volume[93949]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 19 00:06:34 devstack cinder-volume[93949]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93949) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 19 00:06:35 devstack cinder-volume[93949]: INFO dbcounter [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Registered counter for database cinder Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_db.sqlalchemy.engines [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93949) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG dbcounter [-] [93949] Writer thread running {{(pid=93949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 19 00:06:35 devstack cinder-volume[93949]: INFO cinder.rpc [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 19 00:06:35 devstack cinder-volume[93949]: INFO cinder.rpc [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_db.sqlalchemy.engines [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93949) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:35 devstack cinder-volume[93949]: INFO cinder.volume.manager [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Determined volume DB was empty at startup. Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG cinder.volume.manager [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93949) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 19 00:06:35 devstack cinder-volume[93949]: WARNING stevedore.named [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 19 00:06:35 devstack cinder-volume[93949]: WARNING castellan.key_manager [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:06:35 devstack cinder-volume[93949]: WARNING cinder.keymgr.conf_key_mgr [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 19 00:06:35 devstack cinder-volume[93949]: INFO cinder.volume.manager [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_db.sqlalchemy.engines [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93949) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:35 devstack cinder-volume[93949]: INFO oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Starting 1 workers Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Started child 94243 {{(pid=93949) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Full set of CONF: {{(pid=93949) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] ******************************************************************************** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] Configuration options gathered from: {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] ================================================================================ {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] allow_availability_zone_fallback = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] allow_compression_on_image_upload = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] allowed_direct_url_schemes = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[94243]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] api_rate_limit = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] auth_strategy = keystone {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_availability_zone = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_host = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_stats_polling_interval = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backup_api_class = cinder.backup.api.API {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backup_name_template = backup-%s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backup_use_same_host = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backup_use_temp_snapshot = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] chap_password = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] chap_username = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_internal_tenant_project_id = 205fef47a3464f8a86ea0d83c866f10d {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_internal_tenant_user_id = 3f342f857aa9478f9992445c0d388c60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cluster = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] compression_format = gzip {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] compute_api_class = cinder.compute.nova.API {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] config_dir = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] config_source = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] control_exchange = openstack {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] debug = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] default_availability_zone = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] default_group_type = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] default_volume_type = QuobyteHD {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] disk_geometry = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] driver_client_cert = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] driver_client_cert_key = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] driver_data_namespace = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] driver_ssl_cert_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] driver_ssl_cert_verify = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] driver_use_ssl = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] enable_new_services = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] enable_unsupported_driver = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] enabled_backends = ['QuobyteHD'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] enforce_multipath_for_image_xfer = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] filter_function = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_api_insecure = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_api_ssl_compression = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_ca_certificates_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_catalog_info = image:glance:publicURL {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_num_retries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance_request_timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] goodness_function = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] graceful_shutdown_timeout = 5 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] group_api_class = cinder.group.api.API {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] host = devstack {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_compress_on_upload = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_conversion_address_space_limit = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_conversion_cpu_limit = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_conversion_disable = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_upload_use_cinder_backend = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_upload_use_internal_tenant = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_volume_cache_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_volume_cache_max_count = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] image_volume_cache_max_size_gb = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] init_host_max_objects_retrieval = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] instance_format = [instance: %(uuid)s] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] iscsi_target_flags = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] iscsi_write_cache = on {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] iser_helper = tgtadm {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] iser_ip_address = 192.168.122.106 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] iser_port = 3260 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Starting volume driver QuobyteDriver (1.2) Aug 19 00:06:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94243) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_color = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_config_append = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:35 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_dir = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_options = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_rotate_interval = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_rotate_interval_type = days {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] log_rotation_type = none {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] max_age = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] max_logfile_count = 30 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] max_logfile_size_mb = 200 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] max_over_subscription_ratio = 20.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] message_reap_interval = 86400 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] message_ttl = 2592000 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] migration_create_volume_timeout_secs = 300 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] monkey_patch = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] monkey_patch_modules = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] my_ip = 192.168.122.106 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] no_snapshot_gb_quota = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] num_iser_scan_tries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] num_shell_tries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] num_volume_device_scan_tries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] nvmeof_conn_info_version = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] nvmet_ns_id = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] nvmet_port_id = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_max_limit = 1000 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_volume_ext_list = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_volume_listen_port = 8776 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_volume_use_ssl = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] osapi_volume_workers = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] per_volume_size_limit = -1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] periodic_fuzzy_delay = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] periodic_interval = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] public_endpoint = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] publish_errors = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_backup_gigabytes = 1000 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_backups = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_gigabytes = 1000 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_groups = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_snapshots = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] quota_volumes = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] rate_limit_burst = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] rate_limit_except_level = CRITICAL {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] rate_limit_interval = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] reinit_driver_count = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] replication_device = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] report_discard_supported = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] report_interval = 120 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] reservation_clean_interval = 86400 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] reservation_expire = 86400 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] reserved_image_namespaces = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] reserved_percentage = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] rpc_response_timeout = 120 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] run_external_periodic_tasks = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] scst_target_driver = iscsi {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] scst_target_iqn_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_down_time = 720 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] shell_completion = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] snapshot_name_template = snapshot-%s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] split_loggers = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] state_path = /opt/stack/data/cinder {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] storage_availability_zone = nova {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] storage_protocol = iSCSI {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] syslog_log_facility = LOG_USER {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] target_helper = lioadm {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] target_ip_address = 192.168.122.106 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] target_port = 3260 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] target_protocol = iscsi {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] target_secondary_ip_addresses = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] trace_flags = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] transport_url = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] until_refresh = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_chap_auth = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_default_quota_class = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_journal = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_json = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_multipath_for_image_xfer = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_stderr = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] use_syslog = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] verify_glance_signatures = enabled {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_api_class = cinder.volume.api.API {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_backend_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_clear = zero {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_clear_ionice = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_clear_size = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_copy_bps_limit = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_dd_blocksize = 1M {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_name_template = volume-%s {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_service_inithost_offload = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volume_usage_audit_period = month {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] zoning_mode = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_concurrency.disable_process_locking = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.auth_section = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.auth_type = password {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.auth_version = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.cache = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.include_service_catalog = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.insecure = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.interface = public {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_password = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94243) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 19 00:06:36 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 19 00:06:36 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Running cmd (subprocess): mount.quobyte {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcache_username = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.region_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.service_type = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.backend = dogpile.cache.null {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.backend_argument = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.backend_expiration_time = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.config_prefix = cache.oslo {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.debug_cache_backend = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.enable_retry_client = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.enable_socket_keepalive = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.expiration_time = 600 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.hashclient_retry_attempts = 2 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_dead_retry = 300 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_pool_maxsize = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_sasl_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.password = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.proxies = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.redis_db = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.redis_server = localhost:6379 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.retry_attempts = 2 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.retry_delay = 0.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.socket_keepalive_count = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.socket_keepalive_idle = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.socket_keepalive_interval = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.socket_timeout = 1.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.tls_allowed_ciphers = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.tls_cafile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.tls_certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.tls_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.tls_keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cache.username = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] coordination.backend_url = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.asyncio_connection = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.asyncio_slave_connection = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.backend = sqlalchemy {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.connection = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.connection_debug = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.connection_parameters = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.connection_recycle_time = 3600 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.connection_trace = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.db_inc_retry_interval = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.db_max_retries = 20 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.db_max_retry_interval = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.db_retry_interval = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.max_overflow = 50 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.max_pool_size = 5 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.max_retries = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.mysql_wsrep_sync_wait = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.pool_timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.retry_interval = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.slave_connection = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.sqlite_synchronous = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.synchronous_reader = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] database.use_db_reconnect = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.connection_string = messaging:// {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.es_doc_type = notification {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.es_scroll_size = 10000 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.es_scroll_time = 2m {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.filter_error_trace = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.hmac_keys = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.sentinel_service_name = mymaster {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.socket_timeout = 0.1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.trace_requests = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler.trace_sqlalchemy = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler_jaeger.process_tags = {} {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler_jaeger.service_name_prefix = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] profiler_otlp.service_name_prefix = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.enforce_new_defaults = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.policy_default_rule = default {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.policy_file = policy.yaml {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.group = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.helper_command = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] privsep_osbrick.user = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.group = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.helper_command = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] cinder_sys_admin.user = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.auth_section = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.auth_type = password {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.cafile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.collect_timing = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.insecure = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.send_service_user_token = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.split_loggers = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] service_user.timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.auth_section = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.auth_type = password {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.collect_timing = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.insecure = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.region_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.split_loggers = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] glance.timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.backend_availability_zone = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.chap_password = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.chap_username = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.disk_geometry = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.driver_client_cert = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.driver_client_cert_key = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.driver_data_namespace = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.driver_use_ssl = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.extra_capabilities = {} {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.filter_function = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.goodness_function = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.iscsi_target_flags = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.iscsi_write_cache = on {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.iser_helper = tgtadm {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.iser_port = 3260 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_host = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_login = admin {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_mount_options = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_password = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_private_key = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_share_path = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.num_shell_tries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.quobyte_volume_url = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.replication_device = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.report_discard_supported = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.reserved_percentage = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.target_helper = tgtadm {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.target_port = 3260 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.target_protocol = iscsi {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.trace_flags = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.unique_fqdn_network = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.use_chap_auth = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_backend_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_clear = zero {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_clear_ionice = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_clear_size = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack quobyte-client[94253]: Reading configuration file: /etc/quobyte/client.cfg Aug 19 00:06:36 devstack quobyte-client[94253]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_reports.file_event_handler = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_reports.log_dir = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.backend_availability_zone = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.backend_host = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] CMD "mount.quobyte" returned: 1 in 0.164s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.chap_password = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.chap_username = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.chiscsi_conf = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.disk_geometry = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.driver_client_cert = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.driver_data_namespace = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.driver_use_ssl = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.extra_capabilities = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.filter_function = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.goodness_function = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.iser_helper = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.iser_ip_address = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.iser_port = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.iser_target_prefix = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_host = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_login = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_mount_options = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_password = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_private_key = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_share_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_ssh_port = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.num_shell_tries = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.nvmet_port_id = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.replication_device = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.report_discard_supported = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.reserved_percentage = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.scst_target_driver = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.storage_protocol = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.target_helper = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.target_ip_address = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.target_port = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.target_prefix = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.target_protocol = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.trace_flags = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.use_chap_auth = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_clear = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_clear_size = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] QuobyteHD.volumes_dir = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_notifications.driver = [] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_notifications.retry = -1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] key_manager.fixed_key = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.barbican_api_version = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.barbican_endpoint = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.barbican_endpoint_type = public {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.barbican_region_name = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.cafile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.collect_timing = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.insecure = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.number_of_retries = 60 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.retry_delay = 1 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.send_service_user_token = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.split_loggers = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.verify_ssl = True {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican.verify_ssl_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.auth_section = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.auth_type = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.cafile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.certfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.collect_timing = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.insecure = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.keyfile = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.split_loggers = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] barbican_service_user.timeout = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.approle_role_id = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.approle_secret_id = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.auth_method = approle {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.auth_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.kv_mountpoint = secret {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.kv_path = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.kv_version = 2 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.namespace = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.root_token_id = **** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.ssl_ca_crt_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.timeout = 60.0 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.token_file = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.token_role = None {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.use_ssl = False {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 19 00:06:36 devstack cinder-volume[93949]: DEBUG oslo_service.backend._eventlet.service [None req-f2af5e9c-ada2-493f-85a2-82754ca92bf4 None None] ******************************************************************************** {{(pid=93949) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 19 00:06:36 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.273s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:36 devstack cinder-volume[94243]: INFO cinder.volume.driver [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Driver hasn't implemented _init_vendor_properties() Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.volume.driver [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953582763672, 'free_capacity_gb': 1775.6953582763672, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94243) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_db.sqlalchemy.engines [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94243) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writer thread running {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.db.api [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Building query based on filter {{(pid=94243) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94243) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:36 devstack cinder-volume[94243]: INFO cinder.keymgr.migration [None req-9e566bf4-692f-4584-9616-b5c7429d7ea6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 19 00:06:36 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:36 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:36 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.231s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:06:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Driver initialization completed successfully. Aug 19 00:06:36 devstack cinder-volume[94243]: INFO cinder.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Initiating service 3 cleanup Aug 19 00:06:36 devstack cinder-volume[94243]: INFO cinder.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Service 3 cleanup completed. Aug 19 00:06:36 devstack cinder-volume[94243]: DEBUG cinder.service [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Creating RPC server for service cinder-volume {{(pid=94243) start /opt/stack/cinder/cinder/service.py:231}} Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG cinder.service [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94243) start /opt/stack/cinder/cinder/service.py:237}} Aug 19 00:06:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:06:37 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:06:37 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:06:37 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Aug 19 00:06:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.229s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:06:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-aa779eb8-cbc4-4810-ba10-cda58c9522ec None None] Driver post RPC initialization completed successfully. Aug 19 00:06:45 devstack cinder-volume[93949]: DEBUG dbcounter [-] [93949] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93949) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:06:46 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:06:47 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=3 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:07:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:07:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 6 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:07:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Flow 'volume_create_manager' (dcb76396-b739-4868-80c6-20ee1b827307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d773b52-d668-47d9-af4d-991a79f24eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d773b52-d668-47d9-af4d-991a79f24eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-394697989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969513fd-d31c-4345-aafb-e4d7b40179a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5291addf9f974f8c94ea7d51de1ee333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:07:35Z,use_quota=True,user_id='c6bb02e4de774b2fb55ca673b006f817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091c2e1c-7dd3-40c3-ac58-9a4b304ab1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091c2e1c-7dd3-40c3-ac58-9a4b304ab1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85bbbb3-1ab9-4c11-8235-f33c2bac3f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85bbbb3-1ab9-4c11-8235-f33c2bac3f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969513fd-d31c-4345-aafb-e4d7b40179a6', 'volume_name': 'volume-969513fd-d31c-4345-aafb-e4d7b40179a6', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf677f2e-1375-4f52-acb0-c32a08220525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf677f2e-1375-4f52-acb0-c32a08220525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477ec7f3-0d66-413c-8df3-4ebd1bc04958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Volume 969513fd-d31c-4345-aafb-e4d7b40179a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969513fd-d31c-4345-aafb-e4d7b40179a6', 'volume_size': 1} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-394697989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969513fd-d31c-4345-aafb-e4d7b40179a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5291addf9f974f8c94ea7d51de1ee333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:07:35Z,use_quota=True,user_id='c6bb02e4de774b2fb55ca673b006f817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Creating volume 969513fd-d31c-4345-aafb-e4d7b40179a6 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:07:35 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:07:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:07:35 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 1073741824 Aug 19 00:07:35 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:07:36 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 1073741824" returned: 0 in 0.614s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:07:36 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 Aug 19 00:07:36 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:07:36 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6" returned: 0 in 0.302s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477ec7f3-0d66-413c-8df3-4ebd1bc04958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969513fd-d31c-4345-aafb-e4d7b40179a6', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc4be2a-7b2c-43bb-9525-5727cd666776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Volume volume-969513fd-d31c-4345-aafb-e4d7b40179a6 (969513fd-d31c-4345-aafb-e4d7b40179a6): created successfully Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc4be2a-7b2c-43bb-9525-5727cd666776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Flow 'volume_create_manager' (dcb76396-b739-4868-80c6-20ee1b827307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:07:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-16e1dc73-83eb-4879-98c0-2562c3665fed tempest-TaggedAttachmentsTest-24475309 None] Created volume successfully. Aug 19 00:07:46 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:07:46 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Flow 'volume_create_manager' (1d738a74-6039-4919-8671-9c2921bdcfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d987a0-e940-4e91-baac-d0efe9cba591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d987a0-e940-4e91-baac-d0efe9cba591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-304915732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8752d6-535d-41fb-89d4-6169c95be307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc065bf848fd49018560296d96c220bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:07:55Z,use_quota=True,user_id='ee0a0f5ef275427eaeba9728f30ec72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2520b7dc-26b1-4cd3-be8d-8e660f25db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2520b7dc-26b1-4cd3-be8d-8e660f25db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74939bb8-ea69-406f-be6c-77f7ccee2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74939bb8-ea69-406f-be6c-77f7ccee2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8752d6-535d-41fb-89d4-6169c95be307', 'volume_name': 'volume-7a8752d6-535d-41fb-89d4-6169c95be307', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b665ec19-0d71-4b44-9e60-85cb791d715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b665ec19-0d71-4b44-9e60-85cb791d715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28742a95-5941-4d1c-a7ac-99892854c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:55 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Volume 7a8752d6-535d-41fb-89d4-6169c95be307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8752d6-535d-41fb-89d4-6169c95be307', 'volume_size': 1} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-304915732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8752d6-535d-41fb-89d4-6169c95be307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc065bf848fd49018560296d96c220bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:07:55Z,use_quota=True,user_id='ee0a0f5ef275427eaeba9728f30ec72f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Creating volume 7a8752d6-535d-41fb-89d4-6169c95be307 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:07:55 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:07:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:07:55 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 1073741824 Aug 19 00:07:55 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:07:56 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Aug 19 00:07:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 1073741824" returned: 0 in 1.155s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:07:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:07:56 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 Aug 19 00:07:56 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:07:57 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307" returned: 0 in 0.563s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28742a95-5941-4d1c-a7ac-99892854c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8752d6-535d-41fb-89d4-6169c95be307', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987170f9-d8f0-4a02-895e-6bc85ee487b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:07:57 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Volume volume-7a8752d6-535d-41fb-89d4-6169c95be307 (7a8752d6-535d-41fb-89d4-6169c95be307): created successfully Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987170f9-d8f0-4a02-895e-6bc85ee487b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:07:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Flow 'volume_create_manager' (1d738a74-6039-4919-8671-9c2921bdcfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:07:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-21bbc610-30af-4204-9064-3b2c05d799c6 tempest-DeleteServersTestJSON-1354778005 None] Created volume successfully. Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Flow 'volume_create_manager' (cfc22dbd-6426-4c0b-8d56-93b0ea3a03ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73f8f32-49ce-46fe-b709-e0184fe868ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73f8f32-49ce-46fe-b709-e0184fe868ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1510969423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6559490e-c450-4df2-ad6d-6fe11a775c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51697b24d30c48dc88147318d61132bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:08:02Z,use_quota=True,user_id='4935e6666fe24f92af8aae72236e2845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34e7c57-da5a-49f6-9758-cc40fd7700a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34e7c57-da5a-49f6-9758-cc40fd7700a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd3f6af-919c-47c3-9c2f-bdf84d223de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd3f6af-919c-47c3-9c2f-bdf84d223de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6559490e-c450-4df2-ad6d-6fe11a775c9e', 'volume_name': 'volume-6559490e-c450-4df2-ad6d-6fe11a775c9e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f8318-b5ce-466d-a68a-a13ba14036ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f8318-b5ce-466d-a68a-a13ba14036ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18fd928-0357-4b07-b779-9586ce01f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:08:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Volume 6559490e-c450-4df2-ad6d-6fe11a775c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6559490e-c450-4df2-ad6d-6fe11a775c9e', 'volume_size': 1} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1510969423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6559490e-c450-4df2-ad6d-6fe11a775c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51697b24d30c48dc88147318d61132bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:08:02Z,use_quota=True,user_id='4935e6666fe24f92af8aae72236e2845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Creating volume 6559490e-c450-4df2-ad6d-6fe11a775c9e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:08:02 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:08:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:02 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e 1073741824 Aug 19 00:08:02 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:03 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e 1073741824" returned: 0 in 1.033s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:03 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e Aug 19 00:08:03 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:04 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e" returned: 0 in 0.575s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18fd928-0357-4b07-b779-9586ce01f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6559490e-c450-4df2-ad6d-6fe11a775c9e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d8054c-30b8-4b96-b8f6-f39bc5f47cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:08:04 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Volume volume-6559490e-c450-4df2-ad6d-6fe11a775c9e (6559490e-c450-4df2-ad6d-6fe11a775c9e): created successfully Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d8054c-30b8-4b96-b8f6-f39bc5f47cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:08:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Flow 'volume_create_manager' (cfc22dbd-6426-4c0b-8d56-93b0ea3a03ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:08:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-186dca93-2696-4b33-a989-75169b6bc24d tempest-VolumesAdminNegativeTest-61674797 None] Created volume successfully. Aug 19 00:08:05 devstack cinder-volume[94243]: WARNING py.warnings [req-5eda4621-bf9d-40c8-bf14-1149dd67703e req-68712af2-a845-4c5b-a500-88969bd81ce2 tempest-DeleteServersTestJSON-1354778005 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 19 00:08:05 devstack cinder-volume[94243]: .first() Aug 19 00:08:05 devstack cinder-volume[94243]: Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5eda4621-bf9d-40c8-bf14-1149dd67703e req-68712af2-a845-4c5b-a500-88969bd81ce2 tempest-DeleteServersTestJSON-1354778005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5eda4621-bf9d-40c8-bf14-1149dd67703e req-68712af2-a845-4c5b-a500-88969bd81ce2 tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5eda4621-bf9d-40c8-bf14-1149dd67703e req-68712af2-a845-4c5b-a500-88969bd81ce2 tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5eda4621-bf9d-40c8-bf14-1149dd67703e req-68712af2-a845-4c5b-a500-88969bd81ce2 tempest-DeleteServersTestJSON-1354778005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-7a8752d6-535d-41fb-89d4-6169c95be307', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ac9cebe-4177-4dde-b77d-843a1d1c2538', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Acquiring lock "cinder-6559490e-c450-4df2-ad6d-6fe11a775c9e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Lock "cinder-6559490e-c450-4df2-ad6d-6fe11a775c9e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:08:06 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-5eda4621-bf9d-40c8-bf14-1149dd67703e req-68712af2-a845-4c5b-a500-88969bd81ce2 tempest-DeleteServersTestJSON-1354778005 None] attachment_update completed successfully. Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Acquiring lock "cinder-quobyte-6559490e-c450-4df2-ad6d-6fe11a775c9e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:08:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Lock "cinder-quobyte-6559490e-c450-4df2-ad6d-6fe11a775c9e" acquired by "delete_volume" :: waited 0.047s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:08:06 devstack cinder-volume[94243]: INFO oslo.privsep.daemon [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjzajmk0u/privsep.sock'] Aug 19 00:08:06 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjzajmk0u/privsep.sock Aug 19 00:08:06 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: Aug 19 00:08:08 devstack cinder-volume[94243]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 19 00:08:09 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:09 devstack cinder-volume[94243]: INFO oslo.privsep.daemon [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Spawned new privsep daemon via rootwrap Aug 19 00:08:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Accepted privsep connection to /tmp/tmpjzajmk0u/privsep.sock {{(pid=94243) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 19 00:08:09 devstack cinder-volume[94243]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 19 00:08:09 devstack cinder-volume[94243]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 19 00:08:09 devstack cinder-volume[94243]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 19 00:08:09 devstack cinder-volume[94243]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95892 Aug 19 00:08:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe36506-9eac-42f8-80e1-d8219aff5842]: (2,) {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:08:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833bcd0-40b2-42e2-be59-c50fec1e1f56]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:08:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:09 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e Aug 19 00:08:09 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:10 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e" returned: 0 in 0.705s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:10 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e Aug 19 00:08:10 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:10 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6559490e-c450-4df2-ad6d-6fe11a775c9e" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Lock "cinder-quobyte-6559490e-c450-4df2-ad6d-6fe11a775c9e" released by "delete_volume" :: held 3.717s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:08:10 devstack cinder-volume[94243]: WARNING cinder.quota [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:08:10 devstack cinder-volume[94243]: WARNING cinder.quota [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Created reservations ['787ce748-8ef8-4fc2-af2f-4b719847bc54', '381b0018-1b46-46ac-ba07-802647489cf7', '828310a5-22a9-4446-b908-cc37aa70351f', 'eaa1739f-9c43-416d-a039-c398a2a33cf0'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:10 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:08:10 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:11 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.734s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:11 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:08:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Deleted volume successfully. Aug 19 00:08:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4dec1ea7-8037-4734-b0e2-ceb6ebcfb9a2 tempest-VolumesAdminNegativeTest-61674797 None] Lock "cinder-6559490e-c450-4df2-ad6d-6fe11a775c9e-delete_volume" released by "delete_volume" :: held 5.153s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:13 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:08:13 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:13 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 8 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:08:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:08:14 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-2c123191-09cc-443e-aacd-5b60ba50d023 req-402a91ad-8e8a-4e84-b046-14c1512bd6e0 tempest-DeleteServersTestJSON-1354778005 None] Terminate volume connection completed successfully. Aug 19 00:08:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-2c123191-09cc-443e-aacd-5b60ba50d023 req-402a91ad-8e8a-4e84-b046-14c1512bd6e0 tempest-DeleteServersTestJSON-1354778005 None] Deleting attachment 4ac9cebe-4177-4dde-b77d-843a1d1c2538. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:08:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Acquiring lock "cinder-7a8752d6-535d-41fb-89d4-6169c95be307-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:08:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Lock "cinder-7a8752d6-535d-41fb-89d4-6169c95be307-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:08:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Acquiring lock "cinder-quobyte-7a8752d6-535d-41fb-89d4-6169c95be307" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:08:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Lock "cinder-quobyte-7a8752d6-535d-41fb-89d4-6169c95be307" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:08:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd360e2-5dad-4614-8e6d-defbc1d5072f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:08:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:17 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 Aug 19 00:08:17 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:18 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307" returned: 0 in 0.409s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:18 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307 Aug 19 00:08:18 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:18 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a8752d6-535d-41fb-89d4-6169c95be307" returned: 0 in 0.304s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Lock "cinder-quobyte-7a8752d6-535d-41fb-89d4-6169c95be307" released by "delete_volume" :: held 0.758s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Created reservations ['423fddb8-1a16-49a9-85fa-5c4ddf87f3de', 'cf4d55e9-887b-4fcc-b608-7f85a71dcdec', 'dbaf3ab9-d4ab-4e37-b374-842beb3cfb10', '4f0ed941-8bf3-4fe9-a7d5-ea9691a2ffe8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:08:18 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:08:18 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:08:19 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Aug 19 00:08:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.479s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:08:19 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:08:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Deleted volume successfully. Aug 19 00:08:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ad0767d-c3f9-48ae-a964-632e1aa689de tempest-DeleteServersTestJSON-1354778005 None] Lock "cinder-7a8752d6-535d-41fb-89d4-6169c95be307-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:08:28 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=23,cinder:SELECT=20,cinder:DELETE=2,cinder:INSERT=4 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:08:29 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:08:47 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:08:47 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:08:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-53046fa3-79ae-4a4a-9712-6ecc727d5f48 req-6cada201-100e-4c39-b54f-f3931521b2f4 tempest-TaggedAttachmentsTest-24475309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:08:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-53046fa3-79ae-4a4a-9712-6ecc727d5f48 req-6cada201-100e-4c39-b54f-f3931521b2f4 tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:08:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-53046fa3-79ae-4a4a-9712-6ecc727d5f48 req-6cada201-100e-4c39-b54f-f3931521b2f4 tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:08:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-53046fa3-79ae-4a4a-9712-6ecc727d5f48 req-6cada201-100e-4c39-b54f-f3931521b2f4 tempest-TaggedAttachmentsTest-24475309 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-969513fd-d31c-4345-aafb-e4d7b40179a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ecb084b-ff04-4ff2-83d1-420d98a03b08', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:09:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-53046fa3-79ae-4a4a-9712-6ecc727d5f48 req-6cada201-100e-4c39-b54f-f3931521b2f4 tempest-TaggedAttachmentsTest-24475309 None] attachment_update completed successfully. Aug 19 00:09:05 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-5e0f1e68-9061-466a-bc3a-d2fa86907f5a req-e7766045-0c21-41a6-ab2e-2d9931bfaa3f tempest-TaggedAttachmentsTest-24475309 None] Terminate volume connection completed successfully. Aug 19 00:09:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5e0f1e68-9061-466a-bc3a-d2fa86907f5a req-e7766045-0c21-41a6-ab2e-2d9931bfaa3f tempest-TaggedAttachmentsTest-24475309 None] Deleting attachment 2ecb084b-ff04-4ff2-83d1-420d98a03b08. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Flow 'volume_create_manager' (dd78262e-4abc-4a44-a0e9-26640fbdbb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922911d7-5d75-4a16-be85-e3e539140408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922911d7-5d75-4a16-be85-e3e539140408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1886195250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61963b7481bc466e973097696754da63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:09:11Z,use_quota=True,user_id='11113f3ad1cf4ad0b5adadb5de3771be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3b749-fae2-4f5a-b0d2-50c89efeeeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc3b749-fae2-4f5a-b0d2-50c89efeeeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8966d01a-0b3e-41d1-adea-299242e6f150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8966d01a-0b3e-41d1-adea-299242e6f150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6', 'volume_name': 'volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a306d8e9-c83a-48e9-9861-5d2f8af20084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a306d8e9-c83a-48e9-9861-5d2f8af20084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c72714-b452-4dec-8fe6-a4ce2a8d279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Volume 1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6', 'volume_size': 1} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1886195250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61963b7481bc466e973097696754da63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:09:11Z,use_quota=True,user_id='11113f3ad1cf4ad0b5adadb5de3771be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Creating volume 1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:09:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:09:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:09:11 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:09:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:11 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 1073741824 Aug 19 00:09:11 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:12 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 1073741824" returned: 0 in 1.143s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:12 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 Aug 19 00:09:12 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:12 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6" returned: 0 in 0.522s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c72714-b452-4dec-8fe6-a4ce2a8d279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251857c5-c665-4a49-b345-d233d561b344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Volume volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 (1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6): created successfully Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251857c5-c665-4a49-b345-d233d561b344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Flow 'volume_create_manager' (dd78262e-4abc-4a44-a0e9-26640fbdbb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:09:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e866ae25-b648-47a1-89a8-8ab75bfaa229 tempest-ServerActionsTestOtherA-1252334648 None] Created volume successfully. Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:13 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:09:13 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:14 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.702s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:14 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Acquiring lock "cinder-969513fd-d31c-4345-aafb-e4d7b40179a6-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Lock "cinder-969513fd-d31c-4345-aafb-e4d7b40179a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Acquiring lock "cinder-quobyte-969513fd-d31c-4345-aafb-e4d7b40179a6" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Lock "cinder-quobyte-969513fd-d31c-4345-aafb-e4d7b40179a6" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff5362-04a7-433f-b3bc-2a758c150f55]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:22 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 Aug 19 00:09:22 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:22 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:09:23 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6" returned: 0 in 0.602s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:23 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6 Aug 19 00:09:23 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:23 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-969513fd-d31c-4345-aafb-e4d7b40179a6" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Lock "cinder-quobyte-969513fd-d31c-4345-aafb-e4d7b40179a6" released by "delete_volume" :: held 1.078s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Created reservations ['261ca417-b1a9-4f81-a023-c8d48aaa248c', 'dd382223-ed3f-47a5-860b-3b084f8437f5', 'a0866b6e-9dc7-48da-8a88-24886f6a3524', 'd2f34a13-a451-4fa1-a1aa-f4131dd70b86'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:09:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:09:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:24 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:09:24 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:24 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.281s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:09:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Deleted volume successfully. Aug 19 00:09:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fe72779d-10a4-4036-81e1-b8fa4e1b0017 tempest-TaggedAttachmentsTest-24475309 None] Lock "cinder-969513fd-d31c-4345-aafb-e4d7b40179a6-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:09:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=5 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:09:34 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Flow 'volume_create_manager' (435358e1-de57-430e-8e8d-c6fb590b2e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9b8998-2ce0-4d4f-a5c5-0b43dba23c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9b8998-2ce0-4d4f-a5c5-0b43dba23c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1971493219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f68de4-ca87-4514-b50a-8f645b1aaacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016578a16aac4dcdbf9eedd51f41d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:09:35Z,use_quota=True,user_id='fdbc245485424775a914b88360c0ce3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4db11c0-9ebe-4d9d-9594-598f9d3e40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4db11c0-9ebe-4d9d-9594-598f9d3e40f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42b6a52-5858-4404-ae74-ef5e6900a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42b6a52-5858-4404-ae74-ef5e6900a102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f68de4-ca87-4514-b50a-8f645b1aaacf', 'volume_name': 'volume-75f68de4-ca87-4514-b50a-8f645b1aaacf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa86eaa5-0342-4e49-9851-dcdb86554349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa86eaa5-0342-4e49-9851-dcdb86554349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef8425b-fae5-4b66-b50c-5863c0121cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Volume 75f68de4-ca87-4514-b50a-8f645b1aaacf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f68de4-ca87-4514-b50a-8f645b1aaacf', 'volume_size': 1} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1971493219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f68de4-ca87-4514-b50a-8f645b1aaacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016578a16aac4dcdbf9eedd51f41d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:09:35Z,use_quota=True,user_id='fdbc245485424775a914b88360c0ce3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Creating volume 75f68de4-ca87-4514-b50a-8f645b1aaacf {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:09:35 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:09:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:35 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf 1073741824 Aug 19 00:09:35 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:36 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf 1073741824" returned: 0 in 0.539s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:36 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf Aug 19 00:09:36 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:36 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf" returned: 0 in 0.356s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef8425b-fae5-4b66-b50c-5863c0121cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f68de4-ca87-4514-b50a-8f645b1aaacf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde36720-e82c-4e2f-8ca2-3a057539e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Volume volume-75f68de4-ca87-4514-b50a-8f645b1aaacf (75f68de4-ca87-4514-b50a-8f645b1aaacf): created successfully Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde36720-e82c-4e2f-8ca2-3a057539e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Flow 'volume_create_manager' (435358e1-de57-430e-8e8d-c6fb590b2e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:09:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b8493baa-a1ef-4ddd-a74f-3fb3b8734984 tempest-AttachVolumeTestJSON-953282137 None] Created volume successfully. Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Flow 'volume_create_manager' (73c5bf75-a8c7-449b-826a-06e079b7cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da183ebe-e279-4059-908a-4e2e4c82fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da183ebe-e279-4059-908a-4e2e4c82fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1243588518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408770c4-5736-439e-b8da-d7ba2496b7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15df1436c4394736bb2ccb76953dbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:09:38Z,use_quota=True,user_id='f415aecc97ad4c82ba81de48a6956880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f9c258-0de7-4d46-8e12-8fd3fcf68077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f9c258-0de7-4d46-8e12-8fd3fcf68077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e252ac6a-9bd2-47a7-8c3f-699cdb9ca367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e252ac6a-9bd2-47a7-8c3f-699cdb9ca367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408770c4-5736-439e-b8da-d7ba2496b7d0', 'volume_name': 'volume-408770c4-5736-439e-b8da-d7ba2496b7d0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a5e17e-757e-4473-adda-4d8cb0dc3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a5e17e-757e-4473-adda-4d8cb0dc3e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74536a20-999b-43d3-82b9-c3797275690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:38 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Volume 408770c4-5736-439e-b8da-d7ba2496b7d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408770c4-5736-439e-b8da-d7ba2496b7d0', 'volume_size': 1} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1243588518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408770c4-5736-439e-b8da-d7ba2496b7d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15df1436c4394736bb2ccb76953dbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:09:38Z,use_quota=True,user_id='f415aecc97ad4c82ba81de48a6956880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Creating volume 408770c4-5736-439e-b8da-d7ba2496b7d0 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:09:38 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:38 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 1073741824 Aug 19 00:09:38 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-24249f47-205c-4346-abe8-099158106582 req-c631634c-e8b1-41b3-af0e-6a84cd9a9c4a tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:39 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 1073741824" returned: 0 in 0.527s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:09:39 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 Aug 19 00:09:39 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:09:39 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0" returned: 0 in 0.302s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-24249f47-205c-4346-abe8-099158106582 req-c631634c-e8b1-41b3-af0e-6a84cd9a9c4a tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.603s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74536a20-999b-43d3-82b9-c3797275690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408770c4-5736-439e-b8da-d7ba2496b7d0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a37eac-c7a9-452e-9314-34e5f526dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-24249f47-205c-4346-abe8-099158106582 req-c631634c-e8b1-41b3-af0e-6a84cd9a9c4a tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Volume volume-408770c4-5736-439e-b8da-d7ba2496b7d0 (408770c4-5736-439e-b8da-d7ba2496b7d0): created successfully Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a37eac-c7a9-452e-9314-34e5f526dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Flow 'volume_create_manager' (73c5bf75-a8c7-449b-826a-06e079b7cff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:09:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-eec6578f-5ba0-42f7-b685-8041f4b5085e tempest-AttachVolumeShelveTestJSON-1824095318 None] Created volume successfully. Aug 19 00:09:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-24249f47-205c-4346-abe8-099158106582 req-c631634c-e8b1-41b3-af0e-6a84cd9a9c4a tempest-AttachVolumeTestJSON-953282137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-75f68de4-ca87-4514-b50a-8f645b1aaacf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c11e35e-bbe7-4860-9376-527c3830a5c1', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:09:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-24249f47-205c-4346-abe8-099158106582 req-c631634c-e8b1-41b3-af0e-6a84cd9a9c4a tempest-AttachVolumeTestJSON-953282137 None] attachment_update completed successfully. Aug 19 00:09:49 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:09:49 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:INSERT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:09:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d1c7561c-9bb3-46b4-a648-f1a2d7ca7def req-8a97343d-5086-4f1d-aede-5d5c5af43bdc tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d1c7561c-9bb3-46b4-a648-f1a2d7ca7def req-8a97343d-5086-4f1d-aede-5d5c5af43bdc tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d1c7561c-9bb3-46b4-a648-f1a2d7ca7def req-8a97343d-5086-4f1d-aede-5d5c5af43bdc tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d1c7561c-9bb3-46b4-a648-f1a2d7ca7def req-8a97343d-5086-4f1d-aede-5d5c5af43bdc tempest-ServerActionsTestOtherA-1252334648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f5d1229-44e2-4f28-a572-bd5c20928e3b', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:09:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-d1c7561c-9bb3-46b4-a648-f1a2d7ca7def req-8a97343d-5086-4f1d-aede-5d5c5af43bdc tempest-ServerActionsTestOtherA-1252334648 None] attachment_update completed successfully. Aug 19 00:09:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-24e671db-0330-4f12-951c-d558d3e79dcc req-9806011f-a15a-4ca5-9b06-71bc7710371e tempest-AttachVolumeShelveTestJSON-1824095318 None] No connector for attachment 56fb35bc-8c21-4d45-a680-42e92b1f827a; skipping storage backend terminate_connection call. {{(pid=94243) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 19 00:09:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-24e671db-0330-4f12-951c-d558d3e79dcc req-9806011f-a15a-4ca5-9b06-71bc7710371e tempest-AttachVolumeShelveTestJSON-1824095318 None] Deleting attachment 56fb35bc-8c21-4d45-a680-42e92b1f827a. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:09:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-3b90dff6-d32e-4868-9412-9671e617214c tempest-ServerActionsTestOtherA-1252334648 None] Terminate volume connection completed successfully. Aug 19 00:09:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-3b90dff6-d32e-4868-9412-9671e617214c tempest-ServerActionsTestOtherA-1252334648 None] Deleting attachment 0f5d1229-44e2-4f28-a572-bd5c20928e3b. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:09:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-937529ac-c3b6-4921-a468-859e30c7a6ff tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:09:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-937529ac-c3b6-4921-a468-859e30c7a6ff tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:09:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-937529ac-c3b6-4921-a468-859e30c7a6ff tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:09:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-937529ac-c3b6-4921-a468-859e30c7a6ff tempest-ServerActionsTestOtherA-1252334648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4f7bf15-067c-47f6-8674-eaeddd28fb51', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:09:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-fc638fe4-3497-418b-b475-26c18fff1b9d req-937529ac-c3b6-4921-a468-859e30c7a6ff tempest-ServerActionsTestOtherA-1252334648 None] attachment_update completed successfully. Aug 19 00:10:08 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:10:08 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:13 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:10:13 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:14 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.760s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:14 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:10:14 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:10:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 8 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:10:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:10:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-1182118a-5056-48f5-b0de-e61555d820fd req-8b3617bf-f28a-4b38-85c1-94ce031c0470 tempest-AttachVolumeTestJSON-953282137 None] Terminate volume connection completed successfully. Aug 19 00:10:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-1182118a-5056-48f5-b0de-e61555d820fd req-8b3617bf-f28a-4b38-85c1-94ce031c0470 tempest-AttachVolumeTestJSON-953282137 None] Deleting attachment 4c11e35e-bbe7-4860-9376-527c3830a5c1. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:10:26 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:10:26 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Flow 'volume_create_manager' (6459033b-240a-4303-a484-46c03d156fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4d6d52-2cda-45b5-b757-ee83dfc074be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4d6d52-2cda-45b5-b757-ee83dfc074be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580575917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660109af-ff84-404a-9980-9c74736efd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20db99d781b4d4db8b59882917b53eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:10:39Z,use_quota=True,user_id='7737d2b52a114c64abd8c3ce4bb2699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dc0f87-95ff-4a29-bf67-69ae7fc177da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dc0f87-95ff-4a29-bf67-69ae7fc177da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defc80d5-8010-486b-9cc9-7017a611d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defc80d5-8010-486b-9cc9-7017a611d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660109af-ff84-404a-9980-9c74736efd3d', 'volume_name': 'volume-660109af-ff84-404a-9980-9c74736efd3d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f81f8c-d86a-4a89-a0a2-5bb3b19d0fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f81f8c-d86a-4a89-a0a2-5bb3b19d0fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81995d53-add3-4496-9405-6d6fde252eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Volume 660109af-ff84-404a-9980-9c74736efd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660109af-ff84-404a-9980-9c74736efd3d', 'volume_size': 1} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1580575917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660109af-ff84-404a-9980-9c74736efd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20db99d781b4d4db8b59882917b53eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:10:39Z,use_quota=True,user_id='7737d2b52a114c64abd8c3ce4bb2699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Creating volume 660109af-ff84-404a-9980-9c74736efd3d {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:10:39 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:39 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d 1073741824 Aug 19 00:10:39 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:39 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d 1073741824" returned: 0 in 0.457s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:39 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d Aug 19 00:10:39 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:39 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d" returned: 0 in 0.244s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81995d53-add3-4496-9405-6d6fde252eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660109af-ff84-404a-9980-9c74736efd3d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e098d030-bcc2-4a17-8e23-77901f9eb985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Volume volume-660109af-ff84-404a-9980-9c74736efd3d (660109af-ff84-404a-9980-9c74736efd3d): created successfully Aug 19 00:10:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e098d030-bcc2-4a17-8e23-77901f9eb985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Flow 'volume_create_manager' (6459033b-240a-4303-a484-46c03d156fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:10:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3f62f3d0-90b8-4bd8-b140-90e3454407bd tempest-ServersNegativeTestJSON-1554417464 None] Created volume successfully. Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Flow 'volume_create_manager' (87b40f08-e7f5-4e3e-81d6-f7c1f1c48e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b785e4f-8eb6-403d-a30f-9353690df22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b785e4f-8eb6-403d-a30f-9353690df22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-691094528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16889fe0-5b8e-43b4-8e0a-3b4d1788a266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20db99d781b4d4db8b59882917b53eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:10:41Z,use_quota=True,user_id='7737d2b52a114c64abd8c3ce4bb2699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd50e9a3-2f9d-45f0-ab1d-6f43dcde4bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd50e9a3-2f9d-45f0-ab1d-6f43dcde4bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ba0fed-1be0-4a63-bd88-ca5247b22004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ba0fed-1be0-4a63-bd88-ca5247b22004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16889fe0-5b8e-43b4-8e0a-3b4d1788a266', 'volume_name': 'volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7010cdd-afb2-4753-9ec9-37c5fb58b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7010cdd-afb2-4753-9ec9-37c5fb58b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e9deb5-806b-4a24-9630-62cf62e0d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:41 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Volume 16889fe0-5b8e-43b4-8e0a-3b4d1788a266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266', 'volume_size': 1} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-691094528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16889fe0-5b8e-43b4-8e0a-3b4d1788a266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20db99d781b4d4db8b59882917b53eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:10:41Z,use_quota=True,user_id='7737d2b52a114c64abd8c3ce4bb2699f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Creating volume 16889fe0-5b8e-43b4-8e0a-3b4d1788a266 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:10:41 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:41 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 1073741824 Aug 19 00:10:41 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:41 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 1073741824" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:41 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 Aug 19 00:10:41 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:42 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e9deb5-806b-4a24-9630-62cf62e0d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13430cfc-677b-446f-925f-9635d5afb4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:42 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Volume volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 (16889fe0-5b8e-43b4-8e0a-3b4d1788a266): created successfully Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13430cfc-677b-446f-925f-9635d5afb4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Flow 'volume_create_manager' (87b40f08-e7f5-4e3e-81d6-f7c1f1c48e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:10:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0cc9c484-73a6-4d0f-8dc4-404d1c76452e tempest-ServersNegativeTestJSON-1554417464 None] Created volume successfully. Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "cinder-16889fe0-5b8e-43b4-8e0a-3b4d1788a266-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-16889fe0-5b8e-43b4-8e0a-3b4d1788a266-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "cinder-quobyte-16889fe0-5b8e-43b4-8e0a-3b4d1788a266" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-quobyte-16889fe0-5b8e-43b4-8e0a-3b4d1788a266" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[936519a8-adc6-43c8-87d2-828f4e9dbb94]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:10:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:42 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 Aug 19 00:10:42 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:43 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:43 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266 Aug 19 00:10:43 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:43 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16889fe0-5b8e-43b4-8e0a-3b4d1788a266" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-quobyte-16889fe0-5b8e-43b4-8e0a-3b4d1788a266" released by "delete_volume" :: held 0.709s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Created reservations ['8dea7466-1ef1-471b-aea4-6eb9d3af663f', '7a19bf3d-7a53-4241-b3c6-8cb527c6f696', 'ac726925-27ca-4c1d-88a0-2c00e5cc80b2', '6840042e-cdba-4437-8a82-0bfae8ed14d1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:43 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:10:43 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "cinder-660109af-ff84-404a-9980-9c74736efd3d-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-660109af-ff84-404a-9980-9c74736efd3d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:10:44 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.439s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:10:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Deleted volume successfully. Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "cinder-quobyte-660109af-ff84-404a-9980-9c74736efd3d" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b712c62d-6143-4d90-a96d-153e9b34892e tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-16889fe0-5b8e-43b4-8e0a-3b4d1788a266-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-quobyte-660109af-ff84-404a-9980-9c74736efd3d" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ca38e-e80c-46db-8c40-2b8a29f62910]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:44 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d Aug 19 00:10:44 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:44 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d" returned: 0 in 0.408s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:44 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d Aug 19 00:10:44 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:44 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-660109af-ff84-404a-9980-9c74736efd3d" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-quobyte-660109af-ff84-404a-9980-9c74736efd3d" released by "delete_volume" :: held 0.713s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Created reservations ['7ac29984-597d-4525-8a8f-294b5113ab5e', 'e7ba81c3-e289-4574-a6c8-684ef6bb0904', '46d97a42-a140-4f26-90c3-b756f4e0fb31', 'c33173d5-5ba9-4a0e-a6d9-5d0d4d3bb64c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:45 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:10:45 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-30bebc86-3251-47ef-ae3c-7b47f783a57c req-329d0399-68d4-426d-ba36-dfd3a7de2a20 tempest-ServerActionsTestOtherA-1252334648 None] Terminate volume connection completed successfully. Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-30bebc86-3251-47ef-ae3c-7b47f783a57c req-329d0399-68d4-426d-ba36-dfd3a7de2a20 tempest-ServerActionsTestOtherA-1252334648 None] Deleting attachment c4f7bf15-067c-47f6-8674-eaeddd28fb51. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:10:45 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.283s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:10:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Deleted volume successfully. Aug 19 00:10:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4c24929a-fddd-4879-b13d-ad7ad6ca92d2 tempest-ServersNegativeTestJSON-1554417464 None] Lock "cinder-660109af-ff84-404a-9980-9c74736efd3d-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Flow 'volume_create_manager' (3e796399-64c8-4d89-b1bc-fbbb4529be62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deed761f-ecda-4ca9-a259-338e2fe806f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deed761f-ecda-4ca9-a259-338e2fe806f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-417451347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4631bd8c-6da7-4bee-8698-561b248c4bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61963b7481bc466e973097696754da63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:10:53Z,use_quota=True,user_id='11113f3ad1cf4ad0b5adadb5de3771be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88e96d1-71fc-4597-849c-12f14b0a2f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88e96d1-71fc-4597-849c-12f14b0a2f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdd3b99-5607-4c8f-81f9-dd883485eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdd3b99-5607-4c8f-81f9-dd883485eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4631bd8c-6da7-4bee-8698-561b248c4bd8', 'volume_name': 'volume-4631bd8c-6da7-4bee-8698-561b248c4bd8', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2404d9e8-3210-4209-994f-36437114e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2404d9e8-3210-4209-994f-36437114e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbebf2c-69ef-460c-babd-49e5af20874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:53 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Volume 4631bd8c-6da7-4bee-8698-561b248c4bd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4631bd8c-6da7-4bee-8698-561b248c4bd8', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 19 00:10:53 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Trying to clone 4631bd8c-6da7-4bee-8698-561b248c4bd8 from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:10:54 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Image download 20.69 MB at 20.69 MB/s Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e5a754-a726-4f64-87a8-181abd9a32e3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:54 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD Aug 19 00:10:54 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:54 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 is fetched for user 11113f3ad1cf4ad0b5adadb5de3771be. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c42ad-df7a-4e22-9931-aab0e80a0703]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:54 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD Aug 19 00:10:54 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:54 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-417451347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4631bd8c-6da7-4bee-8698-561b248c4bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61963b7481bc466e973097696754da63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:10:53Z,use_quota=True,user_id='11113f3ad1cf4ad0b5adadb5de3771be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Creating volume 4631bd8c-6da7-4bee-8698-561b248c4bd8 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:10:54 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:10:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:54 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 1073741824 Aug 19 00:10:54 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:55 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 1073741824" returned: 0 in 0.433s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:55 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 Aug 19 00:10:55 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:55 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Attempting download of 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume 4631bd8c-6da7-4bee-8698-561b248c4bd8. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9334cb-7681-4677-9bcc-2be7a6dbbdb7]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:10:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:55 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6 Aug 19 00:10:55 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:56 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:56 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6 Aug 19 00:10:56 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:56 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6" returned: 1 in 0.523s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_m7av58_6' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:10:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2790e9b1-dc42-420e-8273-cefad1540647]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:10:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:56 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD Aug 19 00:10:56 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:57 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:57 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] 71a9806a-90d3-4b78-b2e4-4f74e1036e43 was qcow2, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:10:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:57 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 Aug 19 00:10:57 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:59 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8" returned: 0 in 2.129s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_frhxpcshdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:10:59 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Converted 112.00 MB image at 52.56 MB/s Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:10:59 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 1G Aug 19 00:10:59 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:10:59 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 1G" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Downloaded image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume 4631bd8c-6da7-4bee-8698-561b248c4bd8 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 for user 11113f3ad1cf4ad0b5adadb5de3771be is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Marking volume 4631bd8c-6da7-4bee-8698-561b248c4bd8 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Copying metadata from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 to 4631bd8c-6da7-4bee-8698-561b248c4bd8. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Creating volume glance metadata for volume 4631bd8c-6da7-4bee-8698-561b248c4bd8 backed by image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbebf2c-69ef-460c-babd-49e5af20874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4631bd8c-6da7-4bee-8698-561b248c4bd8', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4417ff8e-38a9-4f4d-b380-30189e7b4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:10:59 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Volume volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 (4631bd8c-6da7-4bee-8698-561b248c4bd8): created successfully Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4417ff8e-38a9-4f4d-b380-30189e7b4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:10:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Flow 'volume_create_manager' (3e796399-64c8-4d89-b1bc-fbbb4529be62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:10:59 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6a6314b2-fe0c-41ba-9640-6a912d222338 tempest-ServerActionsTestOtherA-1252334648 None] Created volume successfully. Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Acquiring lock "cinder-408770c4-5736-439e-b8da-d7ba2496b7d0-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "cinder-408770c4-5736-439e-b8da-d7ba2496b7d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Acquiring lock "cinder-quobyte-408770c4-5736-439e-b8da-d7ba2496b7d0" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "cinder-quobyte-408770c4-5736-439e-b8da-d7ba2496b7d0" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8865d-da10-4084-8fdd-f4800b033397]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:00 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 Aug 19 00:11:00 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:00 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0" returned: 0 in 0.388s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:00 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0 Aug 19 00:11:00 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:01 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-408770c4-5736-439e-b8da-d7ba2496b7d0" returned: 0 in 0.267s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "cinder-quobyte-408770c4-5736-439e-b8da-d7ba2496b7d0" released by "delete_volume" :: held 0.702s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Created reservations ['b4968669-6bd6-48df-af42-f2c962bad0cd', '2f96db8e-fc01-4f1a-bfff-575c384a0be7', '8d17cd07-21ad-4a35-b66a-b0b373f4eb1e', 'f1bbc3f4-27ef-4234-ab27-421b122fa14b'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:01 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:11:01 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:01 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.376s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:11:01 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Deleted volume successfully. Aug 19 00:11:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc2008da-6e60-4ff3-bffd-818118b26944 tempest-AttachVolumeShelveTestJSON-1824095318 None] Lock "cinder-408770c4-5736-439e-b8da-d7ba2496b7d0-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Flow 'volume_create_manager' (cc28d6bf-47ec-419a-8f73-5581aeaad5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8dcd8-84ba-4233-a995-f8400d4f6ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8dcd8-84ba-4233-a995-f8400d4f6ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-669883495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fa05dd-f78e-4684-b69d-fe21c53b3714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceda43f472149999b50052134cb3fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:02Z,use_quota=True,user_id='bc97db9f0bf4486ba498375e96ba9793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5472b5d9-8ab8-4df6-b54d-d83431fff0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5472b5d9-8ab8-4df6-b54d-d83431fff0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b54ed3a-cd71-4f8e-a7e7-a1a5ba430b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b54ed3a-cd71-4f8e-a7e7-a1a5ba430b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fa05dd-f78e-4684-b69d-fe21c53b3714', 'volume_name': 'volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a19a12c-e33f-4804-bf71-b61fbf170b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a19a12c-e33f-4804-bf71-b61fbf170b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39fe34e-28ff-463b-94e9-d55195b8af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Volume c5fa05dd-f78e-4684-b69d-fe21c53b3714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714', 'volume_size': 1} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-669883495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fa05dd-f78e-4684-b69d-fe21c53b3714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ceda43f472149999b50052134cb3fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:02Z,use_quota=True,user_id='bc97db9f0bf4486ba498375e96ba9793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Creating volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:11:02 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:11:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:02 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 1073741824 Aug 19 00:11:02 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:03 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 1073741824" returned: 0 in 0.674s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:03 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 Aug 19 00:11:03 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:03 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714" returned: 0 in 0.391s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39fe34e-28ff-463b-94e9-d55195b8af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b70a1-6a65-43cb-a73c-14e44a313e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:03 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Volume volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 (c5fa05dd-f78e-4684-b69d-fe21c53b3714): created successfully Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b70a1-6a65-43cb-a73c-14e44a313e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Flow 'volume_create_manager' (cc28d6bf-47ec-419a-8f73-5581aeaad5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-44ee3848-e992-47db-aeb0-be51aac9e690 req-1d09dc8d-09c5-4a83-a765-f78be4aead84 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-44ee3848-e992-47db-aeb0-be51aac9e690 req-1d09dc8d-09c5-4a83-a765-f78be4aead84 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:03 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8c1c4ff2-f3dc-4094-b6bf-5e2e587a4ed9 tempest-SnapshotsActionsTest-1513731183 None] Created volume successfully. Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-44ee3848-e992-47db-aeb0-be51aac9e690 req-1d09dc8d-09c5-4a83-a765-f78be4aead84 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-44ee3848-e992-47db-aeb0-be51aac9e690 req-1d09dc8d-09c5-4a83-a765-f78be4aead84 tempest-ServerActionsTestOtherA-1252334648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-4631bd8c-6da7-4bee-8698-561b248c4bd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d3f8799-256a-4b6e-b490-6476c7775166', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:11:03 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-44ee3848-e992-47db-aeb0-be51aac9e690 req-1d09dc8d-09c5-4a83-a765-f78be4aead84 tempest-ServerActionsTestOtherA-1252334648 None] attachment_update completed successfully. Aug 19 00:11:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Creating offline snapshot 0fbc9e22-c329-4a11-824a-4bbf7db734b4 of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:11:04 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90df6ab-e62e-4a6d-9d87-72b53f3b37b4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:05 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 Aug 19 00:11:05 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:05 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714" returned: 0 in 0.431s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:05 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 1G Aug 19 00:11:05 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:05 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 1G" returned: 0 in 0.616s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:05 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:06 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:06 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.471s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:06 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 is being set with open permissions: ugo+rw Aug 19 00:11:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:06 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:06 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:06 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.283s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:06 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info Aug 19 00:11:06 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:07 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info" returned: 0 in 0.357s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:07 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info is being set with open permissions: ugo+rw Aug 19 00:11:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:07 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info Aug 19 00:11:07 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:07 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.info" returned: 0 in 0.270s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-57fe9b7f-73f2-4d01-8c77-b0ccc5db5414 tempest-SnapshotsActionsTest-1513731183 None] Create snapshot completed successfully Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Creating offline snapshot c73cd4cd-faae-4776-bff3-daf62dc4fb38 of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57744703-b0d5-4bdf-9c1a-653df3206229]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:09 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:09 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:09 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.464s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:09 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 1G Aug 19 00:11:09 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:10 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 1G" returned: 0 in 0.594s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:10 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 Aug 19 00:11:10 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:10 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38" returned: 0 in 0.487s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:10 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 is being set with open permissions: ugo+rw Aug 19 00:11:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:10 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 Aug 19 00:11:10 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:11 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38" returned: 0 in 0.331s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cd674962-efd1-4e7b-89e7-5f8b0216ffca tempest-SnapshotsActionsTest-1513731183 None] Create snapshot completed successfully Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-c73cd4cd-faae-4776-bff3-daf62dc4fb38-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-c73cd4cd-faae-4776-bff3-daf62dc4fb38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-c73cd4cd-faae-4776-bff3-daf62dc4fb38" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c73cd4cd-faae-4776-bff3-daf62dc4fb38" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Deleting offline snapshot c73cd4cd-faae-4776-bff3-daf62dc4fb38 of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] snapshot_file for this snap is: volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6765ac4-7d13-4249-9bc3-235f204a63f0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:13 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 Aug 19 00:11:13 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:13 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:11:13 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:13 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38" returned: 0 in 0.680s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c953d-65aa-4f2e-9c3c-aeed3568471e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:13 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:13 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:13 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.602s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:11:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:11:14 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.756s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:14 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 Aug 19 00:11:14 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:14 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38" returned: 0 in 0.601s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:15 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38 Aug 19 00:11:15 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:15 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c73cd4cd-faae-4776-bff3-daf62dc4fb38" returned: 0 in 0.631s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c73cd4cd-faae-4776-bff3-daf62dc4fb38" released by "_delete_snapshot" :: held 2.832s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" released by "delete_snapshot" :: held 2.878s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:15 devstack cinder-volume[94243]: WARNING cinder.quota [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:11:15 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Created reservations ['a03048f8-6afd-41aa-b977-5c2041333f3c', 'ab9d9eba-0d98-4ae5-bb66-9a43ff65ca22', 'd8d73fa8-c772-4f0a-9083-e7d7795e604a', 'dfeec951-d18e-411a-bf44-0b36db71f378'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Delete snapshot completed successfully. Aug 19 00:11:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-37ef4d60-36ce-4636-8af6-ac977f822584 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-c73cd4cd-faae-4776-bff3-daf62dc4fb38-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Creating offline snapshot c40d9325-38eb-46e7-b9d1-1c66db38c639 of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:11:16 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c693902-0cce-4010-b3a5-a5f5efbf8838]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:17 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:17 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:17 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.773s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:17 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 1G Aug 19 00:11:17 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:18 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 1G" returned: 0 in 0.940s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:18 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 Aug 19 00:11:18 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:19 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639" returned: 0 in 0.901s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:19 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 is being set with open permissions: ugo+rw Aug 19 00:11:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:19 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 Aug 19 00:11:19 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:20 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639" returned: 0 in 0.644s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.443s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-845cf997-63a9-4ef0-b943-f17406f2eb3d tempest-SnapshotsActionsTest-1513731183 None] Create snapshot completed successfully Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-c40d9325-38eb-46e7-b9d1-1c66db38c639-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-c40d9325-38eb-46e7-b9d1-1c66db38c639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-c40d9325-38eb-46e7-b9d1-1c66db38c639" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c40d9325-38eb-46e7-b9d1-1c66db38c639" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Deleting offline snapshot c40d9325-38eb-46e7-b9d1-1c66db38c639 of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] snapshot_file for this snap is: volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98a89a-aa3f-48af-8c1f-e7c70dff4fcc]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:21 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 Aug 19 00:11:21 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:22 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639" returned: 0 in 0.738s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9de5e4-996f-4684-aeff-7c72f3f53fc1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:22 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:22 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:22 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.536s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:22 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 Aug 19 00:11:22 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:23 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639" returned: 0 in 1.217s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:23 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639 Aug 19 00:11:23 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:24 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.c40d9325-38eb-46e7-b9d1-1c66db38c639" returned: 0 in 0.624s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c40d9325-38eb-46e7-b9d1-1c66db38c639" released by "_delete_snapshot" :: held 3.283s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" released by "delete_snapshot" :: held 3.320s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Created reservations ['56de8648-c635-4aee-b547-ac0849df4d27', 'b4686ba1-a3e5-4d90-b9b6-1ecbd6979d45', '228d1cbe-d614-4646-8b6f-38302e435116', '931f4832-b3ad-40b3-abfc-35c9fbe38495'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Delete snapshot completed successfully. Aug 19 00:11:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6f3d90d-750c-419c-855a-585d745e8036 tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-c40d9325-38eb-46e7-b9d1-1c66db38c639-delete_snapshot" released by "delete_snapshot" :: held 3.648s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Creating offline snapshot 042d8904-4ef1-4a13-9627-855178987d9d of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:11:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[513560c9-fa81-4dcd-9b4f-517590028c7f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:26 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:26 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:27 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.766s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:27 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d 1G Aug 19 00:11:27 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:28 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d 1G" returned: 0 in 1.033s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:28 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d Aug 19 00:11:28 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-fb535e32-e26c-473e-aca8-1a88e163395d tempest-ServerActionsTestOtherA-1252334648 None] Terminate volume connection completed successfully. Aug 19 00:11:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-fb535e32-e26c-473e-aca8-1a88e163395d tempest-ServerActionsTestOtherA-1252334648 None] Deleting attachment 8d3f8799-256a-4b6e-b490-6476c7775166. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:11:28 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d" returned: 0 in 0.582s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:28 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d is being set with open permissions: ugo+rw Aug 19 00:11:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:28 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d Aug 19 00:11:28 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:29 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d" returned: 0 in 0.379s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-96c52a39-7ee9-46da-835d-0b80f3a27e2b tempest-SnapshotsActionsTest-1513731183 None] Create snapshot completed successfully Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-042d8904-4ef1-4a13-9627-855178987d9d-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-042d8904-4ef1-4a13-9627-855178987d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-042d8904-4ef1-4a13-9627-855178987d9d" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-042d8904-4ef1-4a13-9627-855178987d9d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Deleting offline snapshot 042d8904-4ef1-4a13-9627-855178987d9d of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] snapshot_file for this snap is: volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[776b193f-aac3-4411-a35b-6a3bd1542be1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:30 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d Aug 19 00:11:30 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:30 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d" returned: 0 in 0.626s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:30 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5febdc7f-dc12-4dfd-b136-24a09d4438d7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:30 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:30 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:31 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.475s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:31 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d Aug 19 00:11:31 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-532e1e41-63e1-4c5e-8fff-b1444746a0a1 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-532e1e41-63e1-4c5e-8fff-b1444746a0a1 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-532e1e41-63e1-4c5e-8fff-b1444746a0a1 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-532e1e41-63e1-4c5e-8fff-b1444746a0a1 tempest-ServerActionsTestOtherA-1252334648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-4631bd8c-6da7-4bee-8698-561b248c4bd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d8b696c-acf2-4884-91c2-34d1ca203893', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:11:31 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-06c3997b-c6de-4b9e-a98e-e353a3e89902 req-532e1e41-63e1-4c5e-8fff-b1444746a0a1 tempest-ServerActionsTestOtherA-1252334648 None] attachment_update completed successfully. Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d" returned: 0 in 0.872s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:31 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d Aug 19 00:11:31 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:32 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.042d8904-4ef1-4a13-9627-855178987d9d" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-042d8904-4ef1-4a13-9627-855178987d9d" released by "_delete_snapshot" :: held 2.412s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" released by "delete_snapshot" :: held 2.469s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:32 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Created reservations ['3d910890-c490-446c-b505-0eef9d1d4902', '8369fec7-0d0f-4b53-b3f5-ac20038c8cec', '9ce53b40-0033-48ed-a354-4ae01a4f47c0', '3a8e8ac6-54d9-47f3-8ce9-9ad987a3447e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Delete snapshot completed successfully. Aug 19 00:11:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-892cbc3d-1faf-4d9a-9b59-920e251adafc tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-042d8904-4ef1-4a13-9627-855178987d9d-delete_snapshot" released by "delete_snapshot" :: held 2.675s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Creating offline snapshot 624d04bb-4c30-41a0-9c1e-f48fd601d7ff of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0dc0ea-b53a-4c26-8124-17e6811a37a2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:34 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:34 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:34 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.684s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:34 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff 1G Aug 19 00:11:34 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:35 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff 1G" returned: 0 in 0.737s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:35 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff Aug 19 00:11:35 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:36 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff" returned: 0 in 0.583s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:36 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff is being set with open permissions: ugo+rw Aug 19 00:11:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:36 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff Aug 19 00:11:36 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:36 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff" returned: 0 in 0.519s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:36 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:11:36 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=69,cinder:SELECT=76,cinder:INSERT=20,cinder:DELETE=7 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:11:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2a93aefb-49b8-4a3d-9cb5-6248bca2c22d tempest-SnapshotsActionsTest-1513731183 None] Create snapshot completed successfully Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-624d04bb-4c30-41a0-9c1e-f48fd601d7ff-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-624d04bb-4c30-41a0-9c1e-f48fd601d7ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Acquiring lock "cinder-quobyte-624d04bb-4c30-41a0-9c1e-f48fd601d7ff" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-624d04bb-4c30-41a0-9c1e-f48fd601d7ff" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Deleting offline snapshot 624d04bb-4c30-41a0-9c1e-f48fd601d7ff of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] snapshot_file for this snap is: volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d4713e-cea2-4fb2-846e-30eb25326314]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:38 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff Aug 19 00:11:38 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:38 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff" returned: 0 in 0.567s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21b1d0-dcf4-4af5-a2d1-4ef5c48f3a71]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:38 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:38 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:39 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.958s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:39 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff Aug 19 00:11:39 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:40 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff" returned: 0 in 0.752s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:40 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff Aug 19 00:11:40 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:40 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.624d04bb-4c30-41a0-9c1e-f48fd601d7ff" returned: 0 in 0.518s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-624d04bb-4c30-41a0-9c1e-f48fd601d7ff" released by "_delete_snapshot" :: held 3.029s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" released by "delete_snapshot" :: held 3.083s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Created reservations ['363e65c5-1d33-4b12-90ed-541202aa1675', 'eb6a2102-4bf0-439d-9d7f-d89ad0630c30', '196af118-f23c-42bd-8551-16867e8bd051', '15074dfc-794a-4664-9585-ecc61b9ef87c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Delete snapshot completed successfully. Aug 19 00:11:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf84fc43-b62b-4084-a66a-7fec16275baa tempest-SnapshotsActionsTest-80379764 None] Lock "cinder-624d04bb-4c30-41a0-9c1e-f48fd601d7ff-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "cinder-0fbc9e22-c329-4a11-824a-4bbf7db734b4-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-0fbc9e22-c329-4a11-824a-4bbf7db734b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "cinder-quobyte-0fbc9e22-c329-4a11-824a-4bbf7db734b4" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-quobyte-0fbc9e22-c329-4a11-824a-4bbf7db734b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Deleting offline snapshot 0fbc9e22-c329-4a11-824a-4bbf7db734b4 of volume c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] snapshot_file for this snap is: volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[30018026-ce9b-45d4-b2a7-932ec716f22c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:42 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:42 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:43 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.372s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:11:43 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4994a0c5-54e1-4723-ab40-162b2197acb1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:43 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 Aug 19 00:11:43 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:43 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714" returned: 0 in 0.513s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:43 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:43 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:44 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:44 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4 Aug 19 00:11:44 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:44 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714.0fbc9e22-c329-4a11-824a-4bbf7db734b4" returned: 0 in 0.273s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-quobyte-0fbc9e22-c329-4a11-824a-4bbf7db734b4" released by "_delete_snapshot" :: held 1.694s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" released by "delete_snapshot" :: held 1.724s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Created reservations ['0d012e41-c1b0-4cba-b42f-89b8e502a845', 'e77c66e9-0e38-49ef-8af1-e9c058386b18', 'dac6309a-a702-4051-8777-322f57821d2b', '01e42f0d-62cd-449b-b1cd-44b6a48557d4'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Delete snapshot completed successfully. Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fda7f4c-d84b-4fee-b128-e661691eb04b tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-0fbc9e22-c329-4a11-824a-4bbf7db734b4-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Flow 'volume_create_manager' (260dcb13-3e98-4eeb-bd42-ac5b97a160e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42df2513-17f8-4139-a825-f48f334ea534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42df2513-17f8-4139-a825-f48f334ea534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-465063054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110e772e-220a-4bce-af59-d686de48293e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea287fe6aecc48c696730feaea9ca0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:45Z,use_quota=True,user_id='ad9bb3702a7d4a8680bedbdaeb2520f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d83d06b-d3b7-423e-bfed-75d72ce7dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d83d06b-d3b7-423e-bfed-75d72ce7dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2108b970-2edb-4c9b-97fa-2d80feba73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2108b970-2edb-4c9b-97fa-2d80feba73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110e772e-220a-4bce-af59-d686de48293e', 'volume_name': 'volume-110e772e-220a-4bce-af59-d686de48293e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e091fb53-82de-4f01-b186-dcc50ba700f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e091fb53-82de-4f01-b186-dcc50ba700f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bede97-8f48-4f90-8b4f-4cda73bd451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Volume 110e772e-220a-4bce-af59-d686de48293e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110e772e-220a-4bce-af59-d686de48293e', 'volume_size': 1} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-465063054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110e772e-220a-4bce-af59-d686de48293e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea287fe6aecc48c696730feaea9ca0d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:45Z,use_quota=True,user_id='ad9bb3702a7d4a8680bedbdaeb2520f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Creating volume 110e772e-220a-4bce-af59-d686de48293e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:11:44 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:11:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:44 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e 1073741824 Aug 19 00:11:44 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "cinder-c5fa05dd-f78e-4684-b69d-fe21c53b3714-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-c5fa05dd-f78e-4684-b69d-fe21c53b3714-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f89c6a-acca-43c2-bc15-b502291ea158]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:45 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 Aug 19 00:11:45 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:45 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e 1073741824" returned: 0 in 0.417s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:45 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e Aug 19 00:11:45 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:45 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:45 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714 Aug 19 00:11:45 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:45 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e" returned: 0 in 0.285s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bede97-8f48-4f90-8b4f-4cda73bd451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110e772e-220a-4bce-af59-d686de48293e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f34cebe-5c61-4a82-95b1-ce54e1d66b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:45 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Volume volume-110e772e-220a-4bce-af59-d686de48293e (110e772e-220a-4bce-af59-d686de48293e): created successfully Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f34cebe-5c61-4a82-95b1-ce54e1d66b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Flow 'volume_create_manager' (260dcb13-3e98-4eeb-bd42-ac5b97a160e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-af66ecec-cb48-4cf7-8559-d3263bd0dc21 tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Created volume successfully. Aug 19 00:11:45 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5fa05dd-f78e-4684-b69d-fe21c53b3714" returned: 0 in 0.274s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-quobyte-c5fa05dd-f78e-4684-b69d-fe21c53b3714" released by "delete_volume" :: held 0.718s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Created reservations ['ba767b16-968b-4d44-aa66-dcaf3a2e0fe2', 'df18949e-4017-4a28-a0ba-376d32d57cbc', '6dea2f33-60d7-496e-8b42-777bf52fb693', '0e100e9b-77e2-4ec8-abc2-a0197f501998'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:46 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:11:46 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:46 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.304s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:46 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:11:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Deleted volume successfully. Aug 19 00:11:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f6774f4d-e809-44c0-a1a8-959c145a7e4f tempest-SnapshotsActionsTest-1513731183 None] Lock "cinder-c5fa05dd-f78e-4684-b69d-fe21c53b3714-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Acquiring lock "cinder-110e772e-220a-4bce-af59-d686de48293e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "cinder-110e772e-220a-4bce-af59-d686de48293e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Acquiring lock "cinder-quobyte-110e772e-220a-4bce-af59-d686de48293e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "cinder-quobyte-110e772e-220a-4bce-af59-d686de48293e" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06c0ecf-c713-4e95-b7f6-6bbbaa6af932]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:47 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e Aug 19 00:11:47 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:47 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e" returned: 0 in 0.399s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:47 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e Aug 19 00:11:47 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:47 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-110e772e-220a-4bce-af59-d686de48293e" returned: 0 in 0.330s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "cinder-quobyte-110e772e-220a-4bce-af59-d686de48293e" released by "delete_volume" :: held 0.776s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:47 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Created reservations ['094f84b0-1d4c-475b-8c87-976d78b749d6', '574abc08-ded1-40a1-a6be-6eceafaa5ca4', 'c0fd3206-fb86-4ee3-9905-5ed472025f54', '5ed8a7f6-595c-4660-b556-9e1dbd132706'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:48 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:11:48 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:48 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.412s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:11:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Deleted volume successfully. Aug 19 00:11:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-efc35201-970b-453f-a699-2aa26624364f tempest-VolumeQuotasNegativeTestJSON-1161219369 None] Lock "cinder-110e772e-220a-4bce-af59-d686de48293e-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Flow 'volume_create_manager' (7385cf86-1093-4036-af1b-efb4e6765eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03aca81f-75ad-4000-b76f-416392ccddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03aca81f-75ad-4000-b76f-416392ccddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1246809570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c827558-c13f-4eb5-97ea-81a95878e987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016578a16aac4dcdbf9eedd51f41d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:52Z,use_quota=True,user_id='fdbc245485424775a914b88360c0ce3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fa4299-ad8d-4700-b7aa-36a82b94cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fa4299-ad8d-4700-b7aa-36a82b94cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f854880a-4481-499d-8521-6087c81793a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f854880a-4481-499d-8521-6087c81793a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c827558-c13f-4eb5-97ea-81a95878e987', 'volume_name': 'volume-2c827558-c13f-4eb5-97ea-81a95878e987', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a5a239-54f0-4849-81de-95f70f3e6378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a5a239-54f0-4849-81de-95f70f3e6378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca0165e-32aa-45d8-b1cc-0ce5d6c54210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:52 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Volume 2c827558-c13f-4eb5-97ea-81a95878e987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c827558-c13f-4eb5-97ea-81a95878e987', 'volume_size': 1} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1246809570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c827558-c13f-4eb5-97ea-81a95878e987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016578a16aac4dcdbf9eedd51f41d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:52Z,use_quota=True,user_id='fdbc245485424775a914b88360c0ce3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Creating volume 2c827558-c13f-4eb5-97ea-81a95878e987 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:11:52 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:11:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:52 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 1073741824 Aug 19 00:11:52 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:53 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 1073741824" returned: 0 in 0.631s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:53 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 Aug 19 00:11:53 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:53 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca0165e-32aa-45d8-b1cc-0ce5d6c54210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c827558-c13f-4eb5-97ea-81a95878e987', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815eb743-5614-46db-9f2e-bb511eebdbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:53 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Volume volume-2c827558-c13f-4eb5-97ea-81a95878e987 (2c827558-c13f-4eb5-97ea-81a95878e987): created successfully Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815eb743-5614-46db-9f2e-bb511eebdbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Flow 'volume_create_manager' (7385cf86-1093-4036-af1b-efb4e6765eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1b07646e-3062-4e06-9c60-f30b6abfa51b tempest-AttachVolumeTestJSON-953282137 None] Created volume successfully. Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-04a44acd-e680-41bd-b628-986b51ab7a5b req-87151788-2a08-4ba1-bb27-4aa648a15869 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-04a44acd-e680-41bd-b628-986b51ab7a5b req-87151788-2a08-4ba1-bb27-4aa648a15869 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-04a44acd-e680-41bd-b628-986b51ab7a5b req-87151788-2a08-4ba1-bb27-4aa648a15869 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-04a44acd-e680-41bd-b628-986b51ab7a5b req-87151788-2a08-4ba1-bb27-4aa648a15869 tempest-AttachVolumeTestJSON-953282137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-2c827558-c13f-4eb5-97ea-81a95878e987', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '593e29e9-bee7-4310-a1ba-251ffe00b2e8', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:11:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-04a44acd-e680-41bd-b628-986b51ab7a5b req-87151788-2a08-4ba1-bb27-4aa648a15869 tempest-AttachVolumeTestJSON-953282137 None] attachment_update completed successfully. Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Flow 'volume_create_manager' (06fda611-9408-46fe-8065-594ca2800e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f64424-857e-4946-abc4-2bf9cb55ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f64424-857e-4946-abc4-2bf9cb55ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-651196490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986d6c7f-15f5-4848-864d-523e115c3a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f78b11a3c24ac68e06eff4dcd4c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:56Z,use_quota=True,user_id='4d60494633ea41638efcc7e20ebfba05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d533c50-217f-408d-983b-343cde36b461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d533c50-217f-408d-983b-343cde36b461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3c5750-3005-4156-a089-c8d62c8c0a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3c5750-3005-4156-a089-c8d62c8c0a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986d6c7f-15f5-4848-864d-523e115c3a7d', 'volume_name': 'volume-986d6c7f-15f5-4848-864d-523e115c3a7d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e326801-384c-42a6-b326-e52d7eef224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e326801-384c-42a6-b326-e52d7eef224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db70598-b2e5-441c-97c5-13c9006cd1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:55 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Volume 986d6c7f-15f5-4848-864d-523e115c3a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986d6c7f-15f5-4848-864d-523e115c3a7d', 'volume_size': 1} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-651196490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986d6c7f-15f5-4848-864d-523e115c3a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f78b11a3c24ac68e06eff4dcd4c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:56Z,use_quota=True,user_id='4d60494633ea41638efcc7e20ebfba05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Creating volume 986d6c7f-15f5-4848-864d-523e115c3a7d {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:11:55 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:11:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:55 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d 1073741824 Aug 19 00:11:55 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:56 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d 1073741824" returned: 0 in 0.460s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:56 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d Aug 19 00:11:56 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:56 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d" returned: 0 in 0.263s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db70598-b2e5-441c-97c5-13c9006cd1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986d6c7f-15f5-4848-864d-523e115c3a7d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22871331-a4ca-46ae-b974-369710c878f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:56 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Volume volume-986d6c7f-15f5-4848-864d-523e115c3a7d (986d6c7f-15f5-4848-864d-523e115c3a7d): created successfully Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22871331-a4ca-46ae-b974-369710c878f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Flow 'volume_create_manager' (06fda611-9408-46fe-8065-594ca2800e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:56 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9e013a8d-8097-4387-beed-5d318fdbf8b8 tempest-VolumesServicesTestJSON-275487041 None] Created volume successfully. Aug 19 00:11:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Acquiring lock "cinder-986d6c7f-15f5-4848-864d-523e115c3a7d-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Lock "cinder-986d6c7f-15f5-4848-864d-523e115c3a7d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Acquiring lock "cinder-quobyte-986d6c7f-15f5-4848-864d-523e115c3a7d" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Lock "cinder-quobyte-986d6c7f-15f5-4848-864d-523e115c3a7d" acquired by "delete_volume" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c22fdc-8190-4c25-86d0-1fc8db9a1a9f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:57 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d Aug 19 00:11:57 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:57 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:57 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d Aug 19 00:11:57 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:57 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-986d6c7f-15f5-4848-864d-523e115c3a7d" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Lock "cinder-quobyte-986d6c7f-15f5-4848-864d-523e115c3a7d" released by "delete_volume" :: held 0.702s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Created reservations ['c112e729-46ec-4a45-939a-ca604e7f6328', '0e266af6-bd61-474c-ae25-020eef018ccd', 'ad162e8d-407d-44d5-866a-d63da127c7aa', '9a0facd7-2b8b-4235-88c0-c7510b44d4a7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:57 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:11:57 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Flow 'volume_create_manager' (823db3c9-2c90-4670-9515-a8f129441075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677c2d76-c914-44c0-8a5f-59251a970b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677c2d76-c914-44c0-8a5f-59251a970b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1889388206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0940f477-9a5f-40df-b552-c5dc67a4b252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016578a16aac4dcdbf9eedd51f41d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:58Z,use_quota=True,user_id='fdbc245485424775a914b88360c0ce3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104713c9-4fdf-4573-b5cf-0254a0da72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104713c9-4fdf-4573-b5cf-0254a0da72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38549e46-7755-4ad9-ba48-280249cf82f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38549e46-7755-4ad9-ba48-280249cf82f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0940f477-9a5f-40df-b552-c5dc67a4b252', 'volume_name': 'volume-0940f477-9a5f-40df-b552-c5dc67a4b252', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bacecd-23c5-4268-b121-d033daf78cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bacecd-23c5-4268-b121-d033daf78cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a798b697-cd22-4753-857b-932de8aca1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:58 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Volume 0940f477-9a5f-40df-b552-c5dc67a4b252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0940f477-9a5f-40df-b552-c5dc67a4b252', 'volume_size': 1} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1889388206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0940f477-9a5f-40df-b552-c5dc67a4b252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016578a16aac4dcdbf9eedd51f41d03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:11:58Z,use_quota=True,user_id='fdbc245485424775a914b88360c0ce3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Creating volume 0940f477-9a5f-40df-b552-c5dc67a4b252 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:11:58 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:58 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.273s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:11:58 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 1073741824 Aug 19 00:11:58 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Deleted volume successfully. Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ca02b075-5a98-4d08-90a5-ebc82b5b4256 tempest-VolumesServicesTestJSON-275487041 None] Lock "cinder-986d6c7f-15f5-4848-864d-523e115c3a7d-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:11:58 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 1073741824" returned: 0 in 0.531s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:11:58 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 Aug 19 00:11:58 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:11:59 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252" returned: 0 in 0.280s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a798b697-cd22-4753-857b-932de8aca1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0940f477-9a5f-40df-b552-c5dc67a4b252', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4882076-b762-446f-bcfe-507d7a724383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:11:59 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Volume volume-0940f477-9a5f-40df-b552-c5dc67a4b252 (0940f477-9a5f-40df-b552-c5dc67a4b252): created successfully Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4882076-b762-446f-bcfe-507d7a724383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:11:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Flow 'volume_create_manager' (823db3c9-2c90-4670-9515-a8f129441075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:11:59 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cc5e37d1-14ff-4c9e-9958-b9af03cd7383 tempest-AttachVolumeTestJSON-953282137 None] Created volume successfully. Aug 19 00:12:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-71cd8612-bd96-43ff-8aec-6b96c4a6fff0 req-23332477-2712-4b59-8321-c90c54f03c04 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-71cd8612-bd96-43ff-8aec-6b96c4a6fff0 req-23332477-2712-4b59-8321-c90c54f03c04 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-71cd8612-bd96-43ff-8aec-6b96c4a6fff0 req-23332477-2712-4b59-8321-c90c54f03c04 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-71cd8612-bd96-43ff-8aec-6b96c4a6fff0 req-23332477-2712-4b59-8321-c90c54f03c04 tempest-AttachVolumeTestJSON-953282137 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-0940f477-9a5f-40df-b552-c5dc67a4b252', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7ebea12-1e31-43fe-8106-9f3afd1503e8', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:12:01 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-71cd8612-bd96-43ff-8aec-6b96c4a6fff0 req-23332477-2712-4b59-8321-c90c54f03c04 tempest-AttachVolumeTestJSON-953282137 None] attachment_update completed successfully. Aug 19 00:12:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-7ff56a87-8215-4e85-a84f-1e3a3a3d2fcb req-3d5e9591-eb11-4e31-bc2b-c4854a5edbbe tempest-AttachVolumeTestJSON-953282137 None] Terminate volume connection completed successfully. Aug 19 00:12:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-7ff56a87-8215-4e85-a84f-1e3a3a3d2fcb req-3d5e9591-eb11-4e31-bc2b-c4854a5edbbe tempest-AttachVolumeTestJSON-953282137 None] Deleting attachment 593e29e9-bee7-4310-a1ba-251ffe00b2e8. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Flow 'volume_create_manager' (f34785cf-ad5b-4460-bcd1-b3cb6a72efc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb927139-496e-4f0c-bfed-b76c9a49e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb927139-496e-4f0c-bfed-b76c9a49e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1735797630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db647310-02d3-4b44-86b3-b9f23d307c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04744f6be53482cb509659c252d8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:06Z,use_quota=True,user_id='f4967d397dc24101a72625422f94ba54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bfafe83-341e-4bd4-86ba-b21c5f550cc1),volume_type_id=1bfafe83-341e-4bd4-86ba-b21c5f550cc1)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9d98b3-aecb-4006-86d8-a2a4bd884564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9d98b3-aecb-4006-86d8-a2a4bd884564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4eb55b-2044-418c-b38a-cecdd8174f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4eb55b-2044-418c-b38a-cecdd8174f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db647310-02d3-4b44-86b3-b9f23d307c90', 'volume_name': 'volume-db647310-02d3-4b44-86b3-b9f23d307c90', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ce7731-c4e8-45f4-83f9-53294c20aad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ce7731-c4e8-45f4-83f9-53294c20aad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29a83a9-a4bd-4568-99a0-436b4100aaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:06 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Volume db647310-02d3-4b44-86b3-b9f23d307c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db647310-02d3-4b44-86b3-b9f23d307c90', 'volume_size': 1} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1735797630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db647310-02d3-4b44-86b3-b9f23d307c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04744f6be53482cb509659c252d8c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:06Z,use_quota=True,user_id='f4967d397dc24101a72625422f94ba54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bfafe83-341e-4bd4-86ba-b21c5f550cc1),volume_type_id=1bfafe83-341e-4bd4-86ba-b21c5f550cc1)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Creating volume db647310-02d3-4b44-86b3-b9f23d307c90 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:06 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:06 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-5bda23d3-2351-4f0b-bfca-77eb801f01a9 req-e771959d-fa37-446f-813f-4984cdf7f8d0 tempest-AttachVolumeTestJSON-953282137 None] Terminate volume connection completed successfully. Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5bda23d3-2351-4f0b-bfca-77eb801f01a9 req-e771959d-fa37-446f-813f-4984cdf7f8d0 tempest-AttachVolumeTestJSON-953282137 None] Deleting attachment e7ebea12-1e31-43fe-8106-9f3afd1503e8. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:12:06 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 1073741824 Aug 19 00:12:06 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:06 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 1073741824" returned: 0 in 0.573s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:06 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 Aug 19 00:12:06 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:07 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29a83a9-a4bd-4568-99a0-436b4100aaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db647310-02d3-4b44-86b3-b9f23d307c90', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1487570b-62d1-4da5-86f0-d1c9cfe39cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:07 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Volume volume-db647310-02d3-4b44-86b3-b9f23d307c90 (db647310-02d3-4b44-86b3-b9f23d307c90): created successfully Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1487570b-62d1-4da5-86f0-d1c9cfe39cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Flow 'volume_create_manager' (f34785cf-ad5b-4460-bcd1-b3cb6a72efc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4eb2c1aa-f47e-4420-aae6-7b922c99a1df tempest-VolumeTypesAccessTest-210247361 None] Created volume successfully. Aug 19 00:12:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Acquiring lock "cinder-db647310-02d3-4b44-86b3-b9f23d307c90-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Lock "cinder-db647310-02d3-4b44-86b3-b9f23d307c90-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Acquiring lock "cinder-quobyte-db647310-02d3-4b44-86b3-b9f23d307c90" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Lock "cinder-quobyte-db647310-02d3-4b44-86b3-b9f23d307c90" acquired by "delete_volume" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:08 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39212a03-dbe1-4d25-9720-981c6a01fcb4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:08 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 Aug 19 00:12:08 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:09 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-90505375-0542-4f4d-a525-7b7648cd2610 tempest-ServerActionsTestOtherA-1252334648 None] Terminate volume connection completed successfully. Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-90505375-0542-4f4d-a525-7b7648cd2610 tempest-ServerActionsTestOtherA-1252334648 None] Deleting attachment 2d8b696c-acf2-4884-91c2-34d1ca203893. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "cinder-4631bd8c-6da7-4bee-8698-561b248c4bd8-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:09 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90" returned: 0 in 0.725s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-4631bd8c-6da7-4bee-8698-561b248c4bd8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:09 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90 Aug 19 00:12:09 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "cinder-quobyte-4631bd8c-6da7-4bee-8698-561b248c4bd8" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-quobyte-4631bd8c-6da7-4bee-8698-561b248c4bd8" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a642f9-aeb1-4472-b46e-e9087e148cea]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:09 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 Aug 19 00:12:09 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:09 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db647310-02d3-4b44-86b3-b9f23d307c90" returned: 0 in 0.523s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Lock "cinder-quobyte-db647310-02d3-4b44-86b3-b9f23d307c90" released by "delete_volume" :: held 1.332s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:10 devstack cinder-volume[94243]: WARNING cinder.quota [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-987040654 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-987040654, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:12:10 devstack cinder-volume[94243]: WARNING cinder.quota [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-987040654 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-987040654, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Created reservations ['8ddea240-9fa6-4264-88c0-e05064754549', '7ea0dfbd-19dd-41fd-9e3c-242df070effa', '5174a6b9-7198-46fa-81dc-bf2d05384d8a', 'ab9dd306-754b-4aa4-be6b-9d86a2cd5597'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:10 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:10 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:10 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8" returned: 0 in 0.750s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:10 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8 Aug 19 00:12:10 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "cinder-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "cinder-quobyte-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-quobyte-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f37a36-21a3-4ea9-a1cb-2430f7479249]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:10 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Deleted volume successfully. Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3b34087c-cffe-471f-adaf-13eb4c701cab tempest-VolumeTypesAccessTest-210247361 None] Lock "cinder-db647310-02d3-4b44-86b3-b9f23d307c90-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:10 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4631bd8c-6da7-4bee-8698-561b248c4bd8" returned: 0 in 0.419s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-quobyte-4631bd8c-6da7-4bee-8698-561b248c4bd8" released by "delete_volume" :: held 1.260s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:10 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 Aug 19 00:12:10 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.quota [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Created reservations ['a73ed096-885f-44d7-9abf-03e828b91ead', '37a049a6-5b28-4473-b6de-82f59fba3955', '04ad7af6-8f1f-4160-944c-e3b19d0e8ee1', 'e7af546a-eef7-4e20-adba-cd48b00d37ff'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:10 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:10 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:11 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6" returned: 0 in 0.703s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:11 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6 Aug 19 00:12:11 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:11 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG cinder.manager [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Deleted volume successfully. Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-05d8c531-d4f0-420e-8edc-a4ddd3052f91 req-4bb0781c-0821-4407-af96-b66522d2fcb0 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-4631bd8c-6da7-4bee-8698-561b248c4bd8-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:11 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-quobyte-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6" released by "delete_volume" :: held 1.215s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Created reservations ['99af204c-b64e-44ad-8b5f-ad0439da97ea', 'e28212c2-ffb7-4935-bb8a-71d3452a2f86', '25415830-e68c-48c7-90c3-7cf88e3b46f3', '783eb650-2c9a-4f16-9306-36a1f53aeb4f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:11 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:11 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:12 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.287s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:12 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Deleted volume successfully. Aug 19 00:12:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bf6e1065-535e-47bd-a580-5a970149d185 tempest-ServerActionsTestOtherA-1252334648 None] Lock "cinder-1007eee6-8ebf-4ce6-a4d3-fa01aa885ee6-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:13 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:13 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:13 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.447s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:12:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:12:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "cinder-0940f477-9a5f-40df-b552-c5dc67a4b252-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-0940f477-9a5f-40df-b552-c5dc67a4b252-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "cinder-quobyte-0940f477-9a5f-40df-b552-c5dc67a4b252" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-quobyte-0940f477-9a5f-40df-b552-c5dc67a4b252" acquired by "delete_volume" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:14 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[928405ea-3062-41ed-9c26-25e5b1656d69]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:14 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 Aug 19 00:12:14 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:15 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252" returned: 0 in 0.452s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:15 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252 Aug 19 00:12:15 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:15 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0940f477-9a5f-40df-b552-c5dc67a4b252" returned: 0 in 0.348s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-quobyte-0940f477-9a5f-40df-b552-c5dc67a4b252" released by "delete_volume" :: held 0.875s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Created reservations ['f324e6e7-22ec-4717-9091-5a29bf77ca5e', 'de845685-ea24-4ce0-a287-9e7692304ac9', '0cb5ea7e-44c5-479e-9395-ae5e7f845490', '5af8bee3-e78b-4569-8b71-0a0e31a8917e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:15 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:15 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "cinder-2c827558-c13f-4eb5-97ea-81a95878e987-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-2c827558-c13f-4eb5-97ea-81a95878e987-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "cinder-quobyte-2c827558-c13f-4eb5-97ea-81a95878e987" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-quobyte-2c827558-c13f-4eb5-97ea-81a95878e987" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd7b08-433a-47cc-9849-f84ba1fb6627]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:16 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.451s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Deleted volume successfully. Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6088f089-6302-4ed4-a46d-c72d69613e4e tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-0940f477-9a5f-40df-b552-c5dc67a4b252-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:16 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 Aug 19 00:12:16 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:16 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987" returned: 0 in 0.462s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:16 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987 Aug 19 00:12:16 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:16 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2c827558-c13f-4eb5-97ea-81a95878e987" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-quobyte-2c827558-c13f-4eb5-97ea-81a95878e987" released by "delete_volume" :: held 0.831s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:16 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Created reservations ['f614e025-6f81-408b-ae1d-ff6e6523e3a0', '7f4daafe-7068-4f0c-b537-df44d30a9ef4', '160c9ec9-9305-4db9-a298-101f67e9e832', 'f0c69cf7-3e7d-4c9c-84be-26ba83819335'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:17 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:17 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "cinder-75f68de4-ca87-4514-b50a-8f645b1aaacf-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-75f68de4-ca87-4514-b50a-8f645b1aaacf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:17 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.411s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Deleted volume successfully. Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "cinder-quobyte-75f68de4-ca87-4514-b50a-8f645b1aaacf" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ea4f8da-b205-4789-95a5-766a7d5f61fe tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-2c827558-c13f-4eb5-97ea-81a95878e987-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-quobyte-75f68de4-ca87-4514-b50a-8f645b1aaacf" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[90126dd9-8b44-43ae-8940-a9df1e8c868d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:17 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf Aug 19 00:12:17 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Flow 'volume_create_manager' (1655dd80-acd8-4a66-9c55-cc615c49ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3aa632-dc59-4f68-987b-f958842e2a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3aa632-dc59-4f68-987b-f958842e2a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-622757711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478e29d7-8f91-4353-8d41-cb60ace456e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8add2f25610487b88a8a41b06c0d8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:18Z,use_quota=True,user_id='bdbf8bbb7e70464fb172c7fd062249d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9115699b-e7d9-412b-9222-58a436bc967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9115699b-e7d9-412b-9222-58a436bc967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e1f8a2-bdff-4040-a14b-ec520abc9645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e1f8a2-bdff-4040-a14b-ec520abc9645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478e29d7-8f91-4353-8d41-cb60ace456e0', 'volume_name': 'volume-478e29d7-8f91-4353-8d41-cb60ace456e0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef86735-700b-4c1a-9761-121f1edc10dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef86735-700b-4c1a-9761-121f1edc10dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d11a3de-05b1-42ce-b9bb-5ae935fd92fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Volume 478e29d7-8f91-4353-8d41-cb60ace456e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478e29d7-8f91-4353-8d41-cb60ace456e0', 'volume_size': 1} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-622757711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478e29d7-8f91-4353-8d41-cb60ace456e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8add2f25610487b88a8a41b06c0d8e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:18Z,use_quota=True,user_id='bdbf8bbb7e70464fb172c7fd062249d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Creating volume 478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:17 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:17 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 1073741824 Aug 19 00:12:17 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:18 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:18 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf Aug 19 00:12:18 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:18 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 1073741824" returned: 0 in 0.496s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:18 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-75f68de4-ca87-4514-b50a-8f645b1aaacf" returned: 0 in 0.343s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:18 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-quobyte-75f68de4-ca87-4514-b50a-8f645b1aaacf" released by "delete_volume" :: held 0.892s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:18 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Created reservations ['0b1840bd-ddf4-4505-839e-0beae0b5418b', 'a7d0ad7c-cc7e-4199-8482-238517e9cddd', 'b8ce7fc4-4d2c-4fb5-a9a3-ddaf65ba1c7d', '1689d492-fddf-4f6e-b8a5-3be230bf0d56'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:18 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:18 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:18 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d11a3de-05b1-42ce-b9bb-5ae935fd92fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478e29d7-8f91-4353-8d41-cb60ace456e0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a732137-f5b7-489e-9ed8-f89af99b96a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:18 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Volume volume-478e29d7-8f91-4353-8d41-cb60ace456e0 (478e29d7-8f91-4353-8d41-cb60ace456e0): created successfully Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a732137-f5b7-489e-9ed8-f89af99b96a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Flow 'volume_create_manager' (1655dd80-acd8-4a66-9c55-cc615c49ad90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:18 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-206f9870-952f-4e53-a4d8-43dc3206d806 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Created volume successfully. Aug 19 00:12:19 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:19 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Deleted volume successfully. Aug 19 00:12:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9c3dd501-f6f5-480f-bd7b-1384640ef6b5 tempest-AttachVolumeTestJSON-953282137 None] Lock "cinder-75f68de4-ca87-4514-b50a-8f645b1aaacf-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Creating offline snapshot df222742-c69c-44af-bec6-823777e0f66e of volume 478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:12:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[587117ac-e92b-4a80-a483-b40c3a108b23]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:20 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 Aug 19 00:12:20 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:20 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0" returned: 0 in 0.400s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:20 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e 1G Aug 19 00:12:20 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:21 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e 1G" returned: 0 in 0.613s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478e29d7-8f91-4353-8d41-cb60ace456e0 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:21 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478e29d7-8f91-4353-8d41-cb60ace456e0 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e Aug 19 00:12:21 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Flow 'volume_create_manager' (740c7b2a-c98f-41bf-a404-4c4bb71406e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9f9f7d-68a8-411b-a957-9f894123bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9f9f7d-68a8-411b-a957-9f894123bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-246616128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce8289e-ef4c-4c7c-8fb1-4d3840d6b929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bcf0cbff6947b5900357c1ff6013dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:21Z,use_quota=True,user_id='ea99c812d33b4f0b845a7a321b27550e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcc3484-1fc7-425b-b3ec-ac7bffc6fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcc3484-1fc7-425b-b3ec-ac7bffc6fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e7ed9e-f045-4f5c-8165-f2fe2534e472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e7ed9e-f045-4f5c-8165-f2fe2534e472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce8289e-ef4c-4c7c-8fb1-4d3840d6b929', 'volume_name': 'volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099488fb-44a4-4834-ad7a-e87bd2054e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099488fb-44a4-4834-ad7a-e87bd2054e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ea7d2a-050d-4274-9078-e9a3f159dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:21 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Volume cce8289e-ef4c-4c7c-8fb1-4d3840d6b929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929', 'volume_size': 1} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:21 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-478e29d7-8f91-4353-8d41-cb60ace456e0 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e" returned: 0 in 0.398s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:21 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e is being set with open permissions: ugo+rw Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:21 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e Aug 19 00:12:21 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:21 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:21 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info Aug 19 00:12:21 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:22 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info" returned: 0 in 0.299s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:22 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info is being set with open permissions: ugo+rw Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:22 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info Aug 19 00:12:22 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:22 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.info" returned: 0 in 0.309s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-246616128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce8289e-ef4c-4c7c-8fb1-4d3840d6b929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bcf0cbff6947b5900357c1ff6013dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:21Z,use_quota=True,user_id='ea99c812d33b4f0b845a7a321b27550e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Creating volume cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:22 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:22 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 1073741824 Aug 19 00:12:22 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e4c67f01-951c-4d82-9d0c-935d001b8f8c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Create snapshot completed successfully Aug 19 00:12:22 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 1073741824" returned: 0 in 0.519s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:22 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 Aug 19 00:12:22 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:23 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ea7d2a-050d-4274-9078-e9a3f159dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ed39af-c790-43cc-b2de-03b479925e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:23 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Volume volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 (cce8289e-ef4c-4c7c-8fb1-4d3840d6b929): created successfully Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ed39af-c790-43cc-b2de-03b479925e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Flow 'volume_create_manager' (740c7b2a-c98f-41bf-a404-4c4bb71406e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1d3547f2-740a-465b-864b-3d5da1d1064e tempest-VolumesListAdminTestJSON-249545892 None] Created volume successfully. Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "cinder-df222742-c69c-44af-bec6-823777e0f66e-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-df222742-c69c-44af-bec6-823777e0f66e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "cinder-quobyte-478e29d7-8f91-4353-8d41-cb60ace456e0" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-quobyte-478e29d7-8f91-4353-8d41-cb60ace456e0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "cinder-quobyte-df222742-c69c-44af-bec6-823777e0f66e" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-quobyte-df222742-c69c-44af-bec6-823777e0f66e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Deleting offline snapshot df222742-c69c-44af-bec6-823777e0f66e of volume 478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] snapshot_file for this snap is: volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f481c76-0333-416d-95ed-40f7a9c35d55]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:24 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e Aug 19 00:12:24 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:24 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e" returned: 0 in 0.461s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-478e29d7-8f91-4353-8d41-cb60ace456e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:12:24 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2419bd-d45b-4bad-a59f-f1df276e01ad]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:24 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 Aug 19 00:12:24 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:24 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0" returned: 0 in 0.532s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:24 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e Aug 19 00:12:24 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Flow 'volume_create_manager' (70abb60b-b47a-4645-873c-299ca661e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e64469-ddff-4659-a606-bcab210d7844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e64469-ddff-4659-a606-bcab210d7844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-529132494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bcf0cbff6947b5900357c1ff6013dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:25Z,use_quota=True,user_id='ea99c812d33b4f0b845a7a321b27550e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c89e75-cabb-4c5c-8063-b19da73673aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c89e75-cabb-4c5c-8063-b19da73673aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c247ccb9-1f83-418e-9181-597a6479294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c247ccb9-1f83-418e-9181-597a6479294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5', 'volume_name': 'volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea292de-b2c5-4003-98ae-582ec2e8564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea292de-b2c5-4003-98ae-582ec2e8564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2698d109-81d6-488d-b846-25143023f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Volume 1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5', 'volume_size': 1} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-529132494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bcf0cbff6947b5900357c1ff6013dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:25Z,use_quota=True,user_id='ea99c812d33b4f0b845a7a321b27550e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Creating volume 1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:25 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:25 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 1073741824 Aug 19 00:12:25 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:25 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e" returned: 0 in 0.435s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:25 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e Aug 19 00:12:25 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:25 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 1073741824" returned: 0 in 0.517s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:25 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0.df222742-c69c-44af-bec6-823777e0f66e" returned: 0 in 0.346s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-quobyte-df222742-c69c-44af-bec6-823777e0f66e" released by "_delete_snapshot" :: held 1.926s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-quobyte-478e29d7-8f91-4353-8d41-cb60ace456e0" released by "delete_snapshot" :: held 1.969s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:25 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 Aug 19 00:12:25 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:25 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Created reservations ['616cd122-08a0-4cef-9b04-66fc1c72860b', '1b566ca3-2fc0-4d37-a8c6-c8d04d4a249e', '1a067ed0-de47-448c-bd05-f06ea4a9ae52', '288d5dc7-a576-45a9-bf72-857fd030b23f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Delete snapshot completed successfully. Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b493557f-a20d-44ba-8d2d-f16614125c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-df222742-c69c-44af-bec6-823777e0f66e-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "cinder-478e29d7-8f91-4353-8d41-cb60ace456e0-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-478e29d7-8f91-4353-8d41-cb60ace456e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:26 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5" returned: 0 in 0.380s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2698d109-81d6-488d-b846-25143023f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb6bba1-f29c-4450-854a-7794968ced33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Volume volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 (1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5): created successfully Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb6bba1-f29c-4450-854a-7794968ced33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Flow 'volume_create_manager' (70abb60b-b47a-4645-873c-299ca661e17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-521bcfbe-9336-460f-b59b-f84d725aa56b tempest-VolumesListAdminTestJSON-249545892 None] Created volume successfully. Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "cinder-quobyte-478e29d7-8f91-4353-8d41-cb60ace456e0" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-quobyte-478e29d7-8f91-4353-8d41-cb60ace456e0" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[163a2c96-48e2-43aa-9a3d-0f1918c78ffa]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:26 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 Aug 19 00:12:26 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:26 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0" returned: 0 in 0.439s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:26 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0 Aug 19 00:12:26 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:27 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-478e29d7-8f91-4353-8d41-cb60ace456e0" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-quobyte-478e29d7-8f91-4353-8d41-cb60ace456e0" released by "delete_volume" :: held 0.817s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Created reservations ['a7795cb3-94de-45f8-82c2-cbc9367791d2', '2c3e3f78-eeb0-4087-8b50-86c121129a1d', 'f7e30d48-966e-46a8-b8cb-6a51253bf42f', '35d5a8d2-5b19-49b8-b211-866f09cafbbf'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:27 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:27 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:27 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.593s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Deleted volume successfully. Aug 19 00:12:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3f90f76b-496d-4d1a-804d-3bb858250f0c tempest-VolumeSnapshotQuotasNegativeTestJSON-215002028 None] Lock "cinder-478e29d7-8f91-4353-8d41-cb60ace456e0-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Flow 'volume_create_manager' (19a6abef-5618-48f5-91f5-6e1eb8291c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64960f9-1278-442e-8b58-49e2114c2812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64960f9-1278-442e-8b58-49e2114c2812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-983497225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912b7da0-523b-4bc0-99bb-7da92109ec1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bcf0cbff6947b5900357c1ff6013dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:28Z,use_quota=True,user_id='ea99c812d33b4f0b845a7a321b27550e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5eeede7-86c6-4b10-9f11-f3ed4683b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5eeede7-86c6-4b10-9f11-f3ed4683b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63d8c17-dc6c-4d86-afd7-6a0cc4036b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63d8c17-dc6c-4d86-afd7-6a0cc4036b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912b7da0-523b-4bc0-99bb-7da92109ec1f', 'volume_name': 'volume-912b7da0-523b-4bc0-99bb-7da92109ec1f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914cb097-627e-45b2-ad16-8c6b46d58e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914cb097-627e-45b2-ad16-8c6b46d58e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b09f91e-a268-4847-858f-2546611548d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:28 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Volume 912b7da0-523b-4bc0-99bb-7da92109ec1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912b7da0-523b-4bc0-99bb-7da92109ec1f', 'volume_size': 1} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-983497225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912b7da0-523b-4bc0-99bb-7da92109ec1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bcf0cbff6947b5900357c1ff6013dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:28Z,use_quota=True,user_id='ea99c812d33b4f0b845a7a321b27550e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Creating volume 912b7da0-523b-4bc0-99bb-7da92109ec1f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:28 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:28 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f 1073741824 Aug 19 00:12:28 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:28 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f 1073741824" returned: 0 in 0.543s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:28 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f Aug 19 00:12:28 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:29 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b09f91e-a268-4847-858f-2546611548d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912b7da0-523b-4bc0-99bb-7da92109ec1f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a549ed-1100-4c61-aa01-14f04f40e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Volume volume-912b7da0-523b-4bc0-99bb-7da92109ec1f (912b7da0-523b-4bc0-99bb-7da92109ec1f): created successfully Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a549ed-1100-4c61-aa01-14f04f40e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Flow 'volume_create_manager' (19a6abef-5618-48f5-91f5-6e1eb8291c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b20b418f-b5c7-4238-a516-a60a355d07d5 tempest-VolumesListAdminTestJSON-249545892 None] Created volume successfully. Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Flow 'volume_create_manager' (ea9eb753-9eaf-4bf3-97b8-0baea8ab2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6fe29e-7583-4679-86e0-6479003efe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6fe29e-7583-4679-86e0-6479003efe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87d8011-0f9d-47b6-955a-82a6ba00428d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae82f0711544d43907d76c30f479f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:31Z,use_quota=True,user_id='34c3dd3128d24486af288dc3889fdffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90504f34-b8fd-4aa2-8ec3-a1756413a7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90504f34-b8fd-4aa2-8ec3-a1756413a7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a7b6fa-d39d-4e6a-96b7-5da05ddee4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a7b6fa-d39d-4e6a-96b7-5da05ddee4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87d8011-0f9d-47b6-955a-82a6ba00428d', 'volume_name': 'volume-e87d8011-0f9d-47b6-955a-82a6ba00428d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dcc00e-4969-42a9-9459-0563e4ddae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dcc00e-4969-42a9-9459-0563e4ddae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98864d0c-d3e4-456b-ba3e-db55db061d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:31 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Volume e87d8011-0f9d-47b6-955a-82a6ba00428d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87d8011-0f9d-47b6-955a-82a6ba00428d', 'volume_size': 1} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87d8011-0f9d-47b6-955a-82a6ba00428d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ae82f0711544d43907d76c30f479f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:31Z,use_quota=True,user_id='34c3dd3128d24486af288dc3889fdffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Creating volume e87d8011-0f9d-47b6-955a-82a6ba00428d {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:31 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:31 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d 1073741824 Aug 19 00:12:31 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:31 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d 1073741824" returned: 0 in 0.480s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:31 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d Aug 19 00:12:31 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:32 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98864d0c-d3e4-456b-ba3e-db55db061d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87d8011-0f9d-47b6-955a-82a6ba00428d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca0284e-631e-440d-8360-eb1c6ff87403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:32 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Volume volume-e87d8011-0f9d-47b6-955a-82a6ba00428d (e87d8011-0f9d-47b6-955a-82a6ba00428d): created successfully Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca0284e-631e-440d-8360-eb1c6ff87403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Flow 'volume_create_manager' (ea9eb753-9eaf-4bf3-97b8-0baea8ab2b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-47a39d22-49e6-4035-8155-21d399302fcf tempest-VolumesListAdminTestJSON-242567321 None] Created volume successfully. Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Acquiring lock "cinder-e87d8011-0f9d-47b6-955a-82a6ba00428d-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Lock "cinder-e87d8011-0f9d-47b6-955a-82a6ba00428d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Acquiring lock "cinder-quobyte-e87d8011-0f9d-47b6-955a-82a6ba00428d" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Lock "cinder-quobyte-e87d8011-0f9d-47b6-955a-82a6ba00428d" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[901091f2-45b4-47a4-96d1-d8a19ec0d35f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "cinder-912b7da0-523b-4bc0-99bb-7da92109ec1f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-912b7da0-523b-4bc0-99bb-7da92109ec1f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "cinder-quobyte-912b7da0-523b-4bc0-99bb-7da92109ec1f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-quobyte-912b7da0-523b-4bc0-99bb-7da92109ec1f" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:33 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d Aug 19 00:12:33 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d1a03-0b26-4ac9-a4c9-9d054f3e4f4e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:33 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f Aug 19 00:12:33 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:33 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d" returned: 0 in 0.556s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:33 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d Aug 19 00:12:33 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:34 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f" returned: 0 in 0.510s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:34 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f Aug 19 00:12:34 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:34 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e87d8011-0f9d-47b6-955a-82a6ba00428d" returned: 0 in 0.416s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Lock "cinder-quobyte-e87d8011-0f9d-47b6-955a-82a6ba00428d" released by "delete_volume" :: held 1.029s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:34 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-912b7da0-523b-4bc0-99bb-7da92109ec1f" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Created reservations ['b7e6e6d3-cb9e-4071-9ca3-986508883837', 'b7151776-f340-4bbd-aeea-5226a4f4e341', 'de53cb09-2851-4560-80f8-fce27790d1a0', 'cf793b3a-9dd5-4362-aabf-30441d1bdbab'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-quobyte-912b7da0-523b-4bc0-99bb-7da92109ec1f" released by "delete_volume" :: held 0.892s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Created reservations ['f5cb9990-067c-42d6-9baf-b63fe06e9fda', 'bbb20352-70dd-4acd-9fe9-7e7a6712aa18', 'fa2d1b33-72ac-4993-8013-034141e09211', '4632b228-8b2f-4d89-8f82-53fb77c697b2'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:34 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:34 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:34 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:34 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:34 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.397s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:34 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Deleted volume successfully. Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d8577b6-fdca-407e-b5fe-69c989a6a9c3 tempest-VolumesListAdminTestJSON-242567321 None] Lock "cinder-e87d8011-0f9d-47b6-955a-82a6ba00428d-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:35 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.339s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Deleted volume successfully. Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f2f5a6ff-a3e2-4886-a0ee-86f11ed179e3 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-912b7da0-523b-4bc0-99bb-7da92109ec1f-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "cinder-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "cinder-quobyte-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-quobyte-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e404b7ae-0a46-4c28-afd0-b7db77315170]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:36 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 Aug 19 00:12:36 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:36 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5" returned: 0 in 0.452s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:36 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5 Aug 19 00:12:36 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:36 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5" returned: 0 in 0.342s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-quobyte-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5" released by "delete_volume" :: held 0.853s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=113,cinder:INSERT=38,cinder:UPDATE=159,cinder:DELETE=12 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=122,cinder:UPDATE=137,cinder:DELETE=12,cinder:INSERT=33 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:12:36 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Created reservations ['4a4d2a6e-9af1-4f66-af75-712ebdb0719e', 'f16e8304-38d4-4c1a-9c69-6c5f935a8caf', 'c7c47c90-6cd6-44f4-ba6d-9274c072c1da', '453d594a-3d2b-454d-95e8-06b268cd422f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:37 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:37 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "cinder-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "cinder-quobyte-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-quobyte-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a05d74e-137a-4cfa-83a3-6a3a8a984eab]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:37 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.432s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Deleted volume successfully. Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-15691d6b-26b9-4712-8ed8-72b7c9990a06 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-1e8d4c6e-6bd3-4d8f-94e8-a2f12e310ed5-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:37 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 Aug 19 00:12:37 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:37 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929" returned: 0 in 0.534s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:38 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929 Aug 19 00:12:38 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:38 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929" returned: 0 in 0.291s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-quobyte-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929" released by "delete_volume" :: held 0.889s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Created reservations ['b22c4d0e-67eb-4eb5-b406-9efc5f0dd3ff', 'b0b83759-65c7-4ae8-8f67-1ed4d0b6bfe3', '25f11e2e-76b0-436c-9d24-4b52357dee48', '3ab658a6-0cc9-4034-a8f1-dfd978c1add8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:38 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:12:38 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:38 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.326s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:12:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Deleted volume successfully. Aug 19 00:12:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-35d6cb2c-432e-4777-9282-17c2ee3666b9 tempest-VolumesListAdminTestJSON-249545892 None] Lock "cinder-cce8289e-ef4c-4c7c-8fb1-4d3840d6b929-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:12:48 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=15,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:12:48 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Flow 'volume_create_manager' (80a2f925-a203-4529-b274-0e466b219397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b175b0-04f0-4c32-a0eb-0182280d4259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b175b0-04f0-4c32-a0eb-0182280d4259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1278250580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db1984d-d4c1-44a6-a4ad-580e1e5fa20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfd941cacfd42118903da0e6a9b45fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:51Z,use_quota=True,user_id='a3657b97289f4bb896fe2ab1518cb737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9af5a8-1c99-4666-acc1-861c3d8c1af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9af5a8-1c99-4666-acc1-861c3d8c1af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8143a01-6db9-45cf-9059-635ce491ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8143a01-6db9-45cf-9059-635ce491ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db1984d-d4c1-44a6-a4ad-580e1e5fa20b', 'volume_name': 'volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8160bf81-19aa-4b7d-8af8-6a3ffbc08d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8160bf81-19aa-4b7d-8af8-6a3ffbc08d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33461bc4-eeb9-40a2-afbb-c8cf151284f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:51 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Volume 9db1984d-d4c1-44a6-a4ad-580e1e5fa20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b', 'volume_size': 1} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1278250580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db1984d-d4c1-44a6-a4ad-580e1e5fa20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfd941cacfd42118903da0e6a9b45fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:12:51Z,use_quota=True,user_id='a3657b97289f4bb896fe2ab1518cb737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Creating volume 9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:12:51 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:12:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:51 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b 1073741824 Aug 19 00:12:51 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:52 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b 1073741824" returned: 0 in 0.836s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:52 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b Aug 19 00:12:52 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:52 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" returned: 0 in 0.335s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33461bc4-eeb9-40a2-afbb-c8cf151284f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f0a38e-7394-4167-a76f-dcde8ca78ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:12:52 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Volume volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b (9db1984d-d4c1-44a6-a4ad-580e1e5fa20b): created successfully Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f0a38e-7394-4167-a76f-dcde8ca78ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:12:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Flow 'volume_create_manager' (80a2f925-a203-4529-b274-0e466b219397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:12:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-73a86a50-a422-4a74-ad5d-26d121108c55 tempest-SnapshotMetadataTestJSON-1687604993 None] Created volume successfully. Aug 19 00:12:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:12:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:12:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Creating offline snapshot 93a846ba-569d-4840-a82c-0119145e3f14 of volume 9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:12:53 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d6933-4fae-4aed-b585-ac389d310a1c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:12:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:53 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b Aug 19 00:12:53 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:54 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" returned: 0 in 0.637s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:54 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 1G Aug 19 00:12:54 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:55 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 1G" returned: 0 in 1.135s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:55 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 Aug 19 00:12:55 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:55 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14" returned: 0 in 0.678s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:55 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 is being set with open permissions: ugo+rw Aug 19 00:12:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:56 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 Aug 19 00:12:56 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:56 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14" returned: 0 in 0.564s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:56 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info Aug 19 00:12:56 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:57 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info" returned: 0 in 0.860s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:57 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info is being set with open permissions: ugo+rw Aug 19 00:12:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:12:57 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info Aug 19 00:12:57 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:12:58 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Aug 19 00:12:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.info" returned: 0 in 0.681s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:12:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.774s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:12:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d54a7c5d-6a70-4cb1-8042-d304425f2b8e tempest-SnapshotMetadataTestJSON-1687604993 None] Create snapshot completed successfully Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "cinder-93a846ba-569d-4840-a82c-0119145e3f14-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-93a846ba-569d-4840-a82c-0119145e3f14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "cinder-quobyte-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-quobyte-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "cinder-quobyte-93a846ba-569d-4840-a82c-0119145e3f14" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-quobyte-93a846ba-569d-4840-a82c-0119145e3f14" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Deleting offline snapshot 93a846ba-569d-4840-a82c-0119145e3f14 of volume 9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] snapshot_file for this snap is: volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[44588673-3ada-4b61-9b23-072e442f78ae]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:00 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 Aug 19 00:13:00 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:01 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14" returned: 0 in 0.784s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:13:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe460ee-4ffa-4e0c-adb2-b62be8e52d04]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:01 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b Aug 19 00:13:01 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:01 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" returned: 0 in 0.725s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:02 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 Aug 19 00:13:02 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:02 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14" returned: 0 in 0.553s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:02 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14 Aug 19 00:13:02 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:03 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b.93a846ba-569d-4840-a82c-0119145e3f14" returned: 0 in 0.818s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-quobyte-93a846ba-569d-4840-a82c-0119145e3f14" released by "_delete_snapshot" :: held 3.162s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-quobyte-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" released by "delete_snapshot" :: held 3.227s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:03 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Created reservations ['473f2c8d-62b2-46cd-b456-201a5fefc3e4', 'b158fd19-499f-420c-871e-fc1cbc8b0037', 'aaaa3dd2-b7f3-4e3e-9083-d4fe1bc98ca5', '0cb272ff-7efc-4b4e-a725-55868886d7b2'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:03 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Delete snapshot completed successfully. Aug 19 00:13:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7ba5f855-e944-4b7f-853f-ac94273ce907 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-93a846ba-569d-4840-a82c-0119145e3f14-delete_snapshot" released by "delete_snapshot" :: held 3.542s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "cinder-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "cinder-quobyte-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-quobyte-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" acquired by "delete_volume" :: waited 0.049s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae8d84-98d7-4abf-a67b-253bb59747c4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:06 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b Aug 19 00:13:06 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:06 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" returned: 0 in 1.108s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:06 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b Aug 19 00:13:06 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:07 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" returned: 0 in 0.666s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-quobyte-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b" released by "delete_volume" :: held 1.948s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Created reservations ['faccbcaa-6509-47c3-83fd-bc57d12d3bb1', '50372b23-e77c-41a7-9377-79223fcaf21c', '5b5b2743-f34d-49d7-90ec-86855e8af019', '78c3ecd9-d68f-4022-ab8c-de99c77946b3'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:08 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:08 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:08 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 1.005s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:08 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:09 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Deleted volume successfully. Aug 19 00:13:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3e888a6f-b5bd-4e6a-8415-68be16e352d7 tempest-SnapshotMetadataTestJSON-1687604993 None] Lock "cinder-9db1984d-d4c1-44a6-a4ad-580e1e5fa20b-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Flow 'volume_create_manager' (9fc1eda7-44bf-433d-9d30-8e3ec9f88ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b7b770-b13f-43a4-bc76-edcec0044cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b7b770-b13f-43a4-bc76-edcec0044cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2000743992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12f8c34-71af-4f7e-8832-d2b48a0c90e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc0c9d2ec2d43b8ab72c2391d1569b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:10Z,use_quota=True,user_id='54c801fb81694573b13d63b01ea6445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f732ca-26c1-45aa-b796-e497ca2b044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f732ca-26c1-45aa-b796-e497ca2b044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29a4729-6b46-4b39-ae8b-2c14e82222c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29a4729-6b46-4b39-ae8b-2c14e82222c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12f8c34-71af-4f7e-8832-d2b48a0c90e8', 'volume_name': 'volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb23fc1-034d-4345-836d-0eb79fa8d5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb23fc1-034d-4345-836d-0eb79fa8d5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629accb8-a614-4ed3-91e7-bf51ba56be27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Volume e12f8c34-71af-4f7e-8832-d2b48a0c90e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8', 'volume_size': 1} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2000743992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12f8c34-71af-4f7e-8832-d2b48a0c90e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc0c9d2ec2d43b8ab72c2391d1569b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:10Z,use_quota=True,user_id='54c801fb81694573b13d63b01ea6445b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Creating volume e12f8c34-71af-4f7e-8832-d2b48a0c90e8 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:10 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:10 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 1073741824 Aug 19 00:13:10 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:11 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 1073741824" returned: 0 in 1.054s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:11 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 Aug 19 00:13:11 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:12 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8" returned: 0 in 0.625s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629accb8-a614-4ed3-91e7-bf51ba56be27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0968c138-6574-41ea-9b11-e087c3e98acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Volume volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 (e12f8c34-71af-4f7e-8832-d2b48a0c90e8): created successfully Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0968c138-6574-41ea-9b11-e087c3e98acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Flow 'volume_create_manager' (9fc1eda7-44bf-433d-9d30-8e3ec9f88ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9db23f09-768d-4f95-9df5-5a16ed003687 tempest-ServerRescueNegativeTestJSON-623154431 None] Created volume successfully. Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:13 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:13 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:13 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.589s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:13:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Flow 'volume_create_manager' (60a20246-5ba5-4522-90e7-0621c5a4e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2df7d6-261c-4439-bf1d-5c77e1f07144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2df7d6-261c-4439-bf1d-5c77e1f07144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-620269294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be21741a-47b2-4e34-93ca-a8ddcb37c3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9e30b357ce4b70906a3fc0f3139760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:14Z,use_quota=True,user_id='4a6a15f8196c4b2f816bcef919768ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e904f831-0f7b-4cdc-9037-d8ed4e405f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e904f831-0f7b-4cdc-9037-d8ed4e405f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b95a286-1d0f-4376-ba70-79cfba7f3bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b95a286-1d0f-4376-ba70-79cfba7f3bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be21741a-47b2-4e34-93ca-a8ddcb37c3d3', 'volume_name': 'volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfeebfa-bdb5-43ac-a083-0bfdcc9bfe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfeebfa-bdb5-43ac-a083-0bfdcc9bfe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d9188c-6e4e-42fa-924d-01b778f16d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Volume be21741a-47b2-4e34-93ca-a8ddcb37c3d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3', 'volume_size': 1} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-620269294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be21741a-47b2-4e34-93ca-a8ddcb37c3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9e30b357ce4b70906a3fc0f3139760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:14Z,use_quota=True,user_id='4a6a15f8196c4b2f816bcef919768ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Creating volume be21741a-47b2-4e34-93ca-a8ddcb37c3d3 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:14 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:14 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 1073741824 Aug 19 00:13:14 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:15 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 1073741824" returned: 0 in 0.752s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:15 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 Aug 19 00:13:15 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:16 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3" returned: 0 in 0.610s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d9188c-6e4e-42fa-924d-01b778f16d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaa9815-5759-42ba-8319-e1e3ab78e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:16 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Volume volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 (be21741a-47b2-4e34-93ca-a8ddcb37c3d3): created successfully Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaa9815-5759-42ba-8319-e1e3ab78e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Flow 'volume_create_manager' (60a20246-5ba5-4522-90e7-0621c5a4e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-373c42d6-26e3-4d12-b243-ac12f4348152 tempest-AbsoluteLimitsTests-151082340 None] Created volume successfully. Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Acquiring lock "cinder-be21741a-47b2-4e34-93ca-a8ddcb37c3d3-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Lock "cinder-be21741a-47b2-4e34-93ca-a8ddcb37c3d3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Acquiring lock "cinder-quobyte-be21741a-47b2-4e34-93ca-a8ddcb37c3d3" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Lock "cinder-quobyte-be21741a-47b2-4e34-93ca-a8ddcb37c3d3" acquired by "delete_volume" :: waited 0.044s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aab029e-70ec-4b75-a01f-f8d34afd3d74]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:17 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 Aug 19 00:13:17 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:17 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3" returned: 0 in 0.737s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:17 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3 Aug 19 00:13:17 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:18 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-be21741a-47b2-4e34-93ca-a8ddcb37c3d3" returned: 0 in 0.540s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Lock "cinder-quobyte-be21741a-47b2-4e34-93ca-a8ddcb37c3d3" released by "delete_volume" :: held 1.359s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Created reservations ['ac4986a1-af23-4f88-8750-33d76a9cde75', '21c08e21-b143-49f8-88a2-3feba71498a4', '81f0ec85-0800-459e-a3bf-e80251b37f95', '466e302a-5989-4f6f-b11f-b8bb32f8e3d1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:18 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:18 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Flow 'volume_create_manager' (c1daecf0-12e3-4ece-8c4d-fb38f32ccbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bff7db-ae57-49fb-aea9-63fc2ed92351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bff7db-ae57-49fb-aea9-63fc2ed92351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2048324988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65883ce-03d6-427c-be52-2c56770d3439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd75c9159f6047b49a61e25f7b56b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:18Z,use_quota=True,user_id='e1a3ac0f848249d79339915054a523fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7d6212-ad45-4737-92ca-c1f3422d0379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7d6212-ad45-4737-92ca-c1f3422d0379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3845f-8f3d-4688-87da-0a98ec9c211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce3845f-8f3d-4688-87da-0a98ec9c211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65883ce-03d6-427c-be52-2c56770d3439', 'volume_name': 'volume-d65883ce-03d6-427c-be52-2c56770d3439', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea466cd9-515d-4d27-874f-b87287b9044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea466cd9-515d-4d27-874f-b87287b9044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5061cb6-b57f-4609-b36e-f81cc20fa51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:18 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Volume d65883ce-03d6-427c-be52-2c56770d3439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65883ce-03d6-427c-be52-2c56770d3439', 'volume_size': 1} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2048324988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65883ce-03d6-427c-be52-2c56770d3439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd75c9159f6047b49a61e25f7b56b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:18Z,use_quota=True,user_id='e1a3ac0f848249d79339915054a523fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Creating volume d65883ce-03d6-427c-be52-2c56770d3439 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:18 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:18 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 1073741824 Aug 19 00:13:18 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:18 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.482s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:18 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Deleted volume successfully. Aug 19 00:13:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d1be32c-4564-49ff-b869-62f414a6865e tempest-AbsoluteLimitsTests-151082340 None] Lock "cinder-be21741a-47b2-4e34-93ca-a8ddcb37c3d3-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:19 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 1073741824" returned: 0 in 0.832s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:19 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 Aug 19 00:13:19 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:20 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439" returned: 0 in 0.497s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5061cb6-b57f-4609-b36e-f81cc20fa51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65883ce-03d6-427c-be52-2c56770d3439', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a93426-82f2-4765-a860-24944653b8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Volume volume-d65883ce-03d6-427c-be52-2c56770d3439 (d65883ce-03d6-427c-be52-2c56770d3439): created successfully Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a93426-82f2-4765-a860-24944653b8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Flow 'volume_create_manager' (c1daecf0-12e3-4ece-8c4d-fb38f32ccbd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1c6a9aaf-9887-474b-bc6b-69fd9acb77bd tempest-VolumesTransfersTest-1561297704 None] Created volume successfully. Aug 19 00:13:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ea826dae-efa1-4cd0-92e1-90308e7d4ec6 tempest-VolumesTransfersTest-245064086 None] Transfer volume completed successfully. Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Acquiring lock "cinder-d65883ce-03d6-427c-be52-2c56770d3439-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-d65883ce-03d6-427c-be52-2c56770d3439-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Acquiring lock "cinder-quobyte-d65883ce-03d6-427c-be52-2c56770d3439" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-quobyte-d65883ce-03d6-427c-be52-2c56770d3439" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad97075-6691-4cfc-a1ad-87d66fdb8d39]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:23 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 Aug 19 00:13:23 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:23 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439" returned: 0 in 0.475s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:23 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439 Aug 19 00:13:23 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:24 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d65883ce-03d6-427c-be52-2c56770d3439" returned: 0 in 0.344s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-quobyte-d65883ce-03d6-427c-be52-2c56770d3439" released by "delete_volume" :: held 0.873s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Created reservations ['afc0ce36-e598-4c6c-a827-3cd18f268c48', '900bf37e-8763-4b33-ae64-ad1a9051b2ec', 'ec63bd7b-dbb9-450f-afdd-881797e05eca', '7156ac04-3e50-4898-8c94-5b1916a97514'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:24 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:24 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:24 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Deleted volume successfully. Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7dff225b-701c-4830-a5d1-6c51e6551aac tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-d65883ce-03d6-427c-be52-2c56770d3439-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Flow 'volume_create_manager' (336bab09-17e6-4ea6-bfe5-3e958a241292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b71f34-2d58-4779-afbf-579e0d8058fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b71f34-2d58-4779-afbf-579e0d8058fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1602296375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec62fb6b-f1a2-40fc-80be-6929c161197a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd75c9159f6047b49a61e25f7b56b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:25Z,use_quota=True,user_id='e1a3ac0f848249d79339915054a523fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bfa2bf-e4a4-4cdf-9a29-529bc86f5763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bfa2bf-e4a4-4cdf-9a29-529bc86f5763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae6ffdb-5858-49c5-8c22-b37fda65296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae6ffdb-5858-49c5-8c22-b37fda65296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec62fb6b-f1a2-40fc-80be-6929c161197a', 'volume_name': 'volume-ec62fb6b-f1a2-40fc-80be-6929c161197a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7571a6-6331-4e51-bdb6-ff805788505d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd7571a6-6331-4e51-bdb6-ff805788505d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c73e464-5b34-41c3-b4d6-b71799e41d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Volume ec62fb6b-f1a2-40fc-80be-6929c161197a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec62fb6b-f1a2-40fc-80be-6929c161197a', 'volume_size': 1} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1602296375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec62fb6b-f1a2-40fc-80be-6929c161197a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd75c9159f6047b49a61e25f7b56b47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:25Z,use_quota=True,user_id='e1a3ac0f848249d79339915054a523fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Creating volume ec62fb6b-f1a2-40fc-80be-6929c161197a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:25 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:25 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a 1073741824 Aug 19 00:13:25 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:25 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a 1073741824" returned: 0 in 0.547s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:26 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a Aug 19 00:13:26 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:26 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a" returned: 0 in 0.270s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Flow 'volume_create_manager' (9a883e4d-93bd-42d6-8fb9-37d45236498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f084d6b-0bdc-4505-ab9b-0154033984f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c73e464-5b34-41c3-b4d6-b71799e41d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec62fb6b-f1a2-40fc-80be-6929c161197a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9ab210-df03-4b26-8f68-14b5baaf0996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f084d6b-0bdc-4505-ab9b-0154033984f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-231210954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdd75a6-6f4d-41ae-94b5-2b681ec887de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c17d65394f74b0d9778c1a0432a32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:26Z,use_quota=True,user_id='1363fbcb72454911bca19f37b1f63223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025f5126-1c17-4f3c-82e2-a1b71cd8254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025f5126-1c17-4f3c-82e2-a1b71cd8254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59087cb0-684f-48ca-9a95-47f38cb20133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59087cb0-684f-48ca-9a95-47f38cb20133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdd75a6-6f4d-41ae-94b5-2b681ec887de', 'volume_name': 'volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e9ae80-27b4-4a9d-9ae9-f2080824a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e9ae80-27b4-4a9d-9ae9-f2080824a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c138df42-6243-46f8-b07a-c6ffb554fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Volume 2cdd75a6-6f4d-41ae-94b5-2b681ec887de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de', 'volume_size': 1} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-231210954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdd75a6-6f4d-41ae-94b5-2b681ec887de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c17d65394f74b0d9778c1a0432a32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:26Z,use_quota=True,user_id='1363fbcb72454911bca19f37b1f63223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Creating volume 2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:26 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Volume volume-ec62fb6b-f1a2-40fc-80be-6929c161197a (ec62fb6b-f1a2-40fc-80be-6929c161197a): created successfully Aug 19 00:13:26 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de 1073741824 Aug 19 00:13:26 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9ab210-df03-4b26-8f68-14b5baaf0996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Flow 'volume_create_manager' (336bab09-17e6-4ea6-bfe5-3e958a241292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0fc437a8-94b4-4431-acb4-9ed328d4ddfd tempest-VolumesTransfersTest-1561297704 None] Created volume successfully. Aug 19 00:13:26 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de 1073741824" returned: 0 in 0.446s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:26 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de Aug 19 00:13:26 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:27 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" returned: 0 in 0.267s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c138df42-6243-46f8-b07a-c6ffb554fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cbd595-0323-46e8-8cde-eaad9062fe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Volume volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de (2cdd75a6-6f4d-41ae-94b5-2b681ec887de): created successfully Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cbd595-0323-46e8-8cde-eaad9062fe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Flow 'volume_create_manager' (9a883e4d-93bd-42d6-8fb9-37d45236498f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-84dc071d-2661-4ae2-bdd7-ef58c6ab259e tempest-VolumesDeleteCascade-271508391 None] Created volume successfully. Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Acquiring lock "cinder-e12f8c34-71af-4f7e-8832-d2b48a0c90e8-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "cinder-e12f8c34-71af-4f7e-8832-d2b48a0c90e8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Acquiring lock "cinder-quobyte-e12f8c34-71af-4f7e-8832-d2b48a0c90e8" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "cinder-quobyte-e12f8c34-71af-4f7e-8832-d2b48a0c90e8" acquired by "delete_volume" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ffecb3-6a3a-4935-a9ec-5896f99434b8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:27 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 Aug 19 00:13:27 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:27 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:27 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8 Aug 19 00:13:27 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Acquiring lock "cinder-ec62fb6b-f1a2-40fc-80be-6929c161197a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-ec62fb6b-f1a2-40fc-80be-6929c161197a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Acquiring lock "cinder-quobyte-ec62fb6b-f1a2-40fc-80be-6929c161197a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-quobyte-ec62fb6b-f1a2-40fc-80be-6929c161197a" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91565e-8c5a-4eef-b2a6-2c532902e4d3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:28 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a Aug 19 00:13:28 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:28 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e12f8c34-71af-4f7e-8832-d2b48a0c90e8" returned: 0 in 0.320s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "cinder-quobyte-e12f8c34-71af-4f7e-8832-d2b48a0c90e8" released by "delete_volume" :: held 0.810s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Created reservations ['58e67124-0170-48c2-8a76-2e7893f51219', 'a1b0c8f4-5849-4565-9d00-4abf8367cebd', '9c177985-0f5e-4f4f-b5ca-16bfd898ec94', '10e4462f-0136-4c59-a2e9-1754f09d703f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:28 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:28 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:28 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a" returned: 0 in 0.555s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:28 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a Aug 19 00:13:28 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Creating offline snapshot 84c5da30-0e05-4c96-8cdf-14dd8ac12dfc of volume 2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd88bd-b20f-40f8-b050-b9f141f854d5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:29 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.799s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Deleted volume successfully. Aug 19 00:13:29 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ec62fb6b-f1a2-40fc-80be-6929c161197a" returned: 0 in 0.588s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-quobyte-ec62fb6b-f1a2-40fc-80be-6929c161197a" released by "delete_volume" :: held 1.201s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9b6ad2f0-0ae0-4269-b648-3b27b993d763 tempest-ServerRescueNegativeTestJSON-623154431 None] Lock "cinder-e12f8c34-71af-4f7e-8832-d2b48a0c90e8-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:29 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de Aug 19 00:13:29 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Created reservations ['a811d941-f1ba-4edc-83ec-473137d52cf3', '54417bba-2fcc-47c7-be19-f9b9483874fd', '38bfe553-cd99-4754-8c3e-4f352075c9fa', '2d442c61-6f66-42e5-98af-abef7cd4e09c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:29 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:29 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:29 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" returned: 0 in 0.638s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:29 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc 1G Aug 19 00:13:29 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:29 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Deleted volume successfully. Aug 19 00:13:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-70bb3117-4ee0-437f-aa71-2c1c9563acf2 tempest-VolumesTransfersTest-1206606861 None] Lock "cinder-ec62fb6b-f1a2-40fc-80be-6929c161197a-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:30 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc 1G" returned: 0 in 0.687s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:30 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:30 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:30 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.462s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:30 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc is being set with open permissions: ugo+rw Aug 19 00:13:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:30 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:30 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:31 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.366s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:31 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info Aug 19 00:13:31 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:31 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info" returned: 0 in 0.365s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:31 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info is being set with open permissions: ugo+rw Aug 19 00:13:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:31 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info Aug 19 00:13:31 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:32 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.info" returned: 0 in 0.482s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2666eeb5-00bf-429b-8455-e2a5293ef278 tempest-VolumesDeleteCascade-271508391 None] Create snapshot completed successfully Aug 19 00:13:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Creating offline snapshot 44d99ec0-69dc-4f01-84a1-e807c17c4557 of volume 2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:13:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4d754-71fd-4476-89ce-01d6ce308698]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:33 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:33 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:34 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.573s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:13:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:34 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 1G Aug 19 00:13:34 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:34 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 1G" returned: 0 in 0.553s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:34 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 Aug 19 00:13:34 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:35 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:35 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 is being set with open permissions: ugo+rw Aug 19 00:13:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:35 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 Aug 19 00:13:35 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:35 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557" returned: 0 in 0.474s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b8c20b5e-fc42-4905-ac45-a6e0ddcb6549 tempest-VolumesDeleteCascade-271508391 None] Create snapshot completed successfully Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Flow 'volume_create_manager' (7b263d22-54f7-4db0-87f9-1badf99b8773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7b4b0-6a7c-4755-bfce-1632d9b2dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7b4b0-6a7c-4755-bfce-1632d9b2dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-613105412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f9ff2-22d4-40d3-872a-8dd6d53cd77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc70e6cc4c44e45bff0e82c13a3bf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:36Z,use_quota=True,user_id='eb16e0d7550f40fd8d05d0aedf0b1741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ccc3be-605d-430d-897b-adb46c02d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ccc3be-605d-430d-897b-adb46c02d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e287d-f72a-4303-ab83-d2919dc13dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5e287d-f72a-4303-ab83-d2919dc13dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100f9ff2-22d4-40d3-872a-8dd6d53cd77c', 'volume_name': 'volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d191f12-92f5-439f-add5-b9f9d1724e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d191f12-92f5-439f-add5-b9f9d1724e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc15855e-b6a0-4257-aa4c-b50c8854e49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Volume 100f9ff2-22d4-40d3-872a-8dd6d53cd77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c', 'volume_size': 1} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-613105412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f9ff2-22d4-40d3-872a-8dd6d53cd77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc70e6cc4c44e45bff0e82c13a3bf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:36Z,use_quota=True,user_id='eb16e0d7550f40fd8d05d0aedf0b1741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Creating volume 100f9ff2-22d4-40d3-872a-8dd6d53cd77c {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:36 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:36 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c 1073741824 Aug 19 00:13:36 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:36 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c 1073741824" returned: 0 in 0.566s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:36 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c Aug 19 00:13:36 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-2cdd75a6-6f4d-41ae-94b5-2b681ec887de-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-2cdd75a6-6f4d-41ae-94b5-2b681ec887de-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Performing cascade delete. {{(pid=94243) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-44d99ec0-69dc-4f01-84a1-e807c17c4557-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-44d99ec0-69dc-4f01-84a1-e807c17c4557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-44d99ec0-69dc-4f01-84a1-e807c17c4557" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-44d99ec0-69dc-4f01-84a1-e807c17c4557" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Deleting offline snapshot 44d99ec0-69dc-4f01-84a1-e807c17c4557 of volume 2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] snapshot_file for this snap is: volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:13:37 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed4790-cb0e-499c-aaa1-06c13a47af59]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c" returned: 0 in 0.417s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc15855e-b6a0-4257-aa4c-b50c8854e49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da225da-e496-4e45-bd1b-51952690cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:37 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Volume volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c (100f9ff2-22d4-40d3-872a-8dd6d53cd77c): created successfully Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6da225da-e496-4e45-bd1b-51952690cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Flow 'volume_create_manager' (7b263d22-54f7-4db0-87f9-1badf99b8773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e0274d42-c6bb-4f68-bf30-ae0b3aab987a tempest-AttachVolumeNegativeTest-1110771946 None] Created volume successfully. Aug 19 00:13:37 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 Aug 19 00:13:37 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:37 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557" returned: 0 in 0.433s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae2156-dbb7-41ef-ac4a-93b4e34d00fb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:37 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:37 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:38 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.440s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:38 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 Aug 19 00:13:38 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:38 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557" returned: 0 in 0.525s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:38 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557 Aug 19 00:13:38 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:38 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.44d99ec0-69dc-4f01-84a1-e807c17c4557" returned: 0 in 0.325s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-44d99ec0-69dc-4f01-84a1-e807c17c4557" released by "_delete_snapshot" :: held 1.881s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" released by "delete_snapshot" :: held 1.911s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Created reservations ['a0200286-3b5c-4e8b-8d3e-92ae28310d76', 'ffdb5323-92b0-45e0-8b83-ea0bab7b1bb1', 'ac950add-3ce2-49da-9744-12a9da84a09d', '01c66e4d-7a29-4e0b-a94f-291ce0d175c3'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Delete snapshot completed successfully. Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-44d99ec0-69dc-4f01-84a1-e807c17c4557-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-84c5da30-0e05-4c96-8cdf-14dd8ac12dfc-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-84c5da30-0e05-4c96-8cdf-14dd8ac12dfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Deleting offline snapshot 84c5da30-0e05-4c96-8cdf-14dd8ac12dfc of volume 2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] snapshot_file for this snap is: volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa3ede4-952c-4de4-a969-3a89b01819aa]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d760093b-4d1e-4a44-be62-ce66ce40e3c7 req-221a19f1-f450-41d9-9c6b-75e1fd386566 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d760093b-4d1e-4a44-be62-ce66ce40e3c7 req-221a19f1-f450-41d9-9c6b-75e1fd386566 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d760093b-4d1e-4a44-be62-ce66ce40e3c7 req-221a19f1-f450-41d9-9c6b-75e1fd386566 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d760093b-4d1e-4a44-be62-ce66ce40e3c7 req-221a19f1-f450-41d9-9c6b-75e1fd386566 tempest-AttachVolumeNegativeTest-1110771946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ef49790-1b91-4365-b8bd-9fd6da4bd1a5', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:13:39 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:39 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-d760093b-4d1e-4a44-be62-ce66ce40e3c7 req-221a19f1-f450-41d9-9c6b-75e1fd386566 tempest-AttachVolumeNegativeTest-1110771946 None] attachment_update completed successfully. Aug 19 00:13:39 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.484s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c2e4e-8bcd-4fbf-90ef-edcdec2963b0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:40 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de Aug 19 00:13:40 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Flow 'volume_create_manager' (d45a5567-3269-4a1e-864f-476edcefb251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:40 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5155c09-159f-4772-af44-3bbbe73ff33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" returned: 0 in 0.507s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:40 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5155c09-159f-4772-af44-3bbbe73ff33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-193991489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31fe0fd-67ff-49c0-843f-0c9b66575c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550efad104a948b0899845d2d2c6cb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:40Z,use_quota=True,user_id='c6cef664d42d4fe1814602af166bc8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:40 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b406aba-5b45-4830-8540-86eed3e83dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b406aba-5b45-4830-8540-86eed3e83dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358a5d4e-ec7c-46e9-8c18-7eee602f5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358a5d4e-ec7c-46e9-8c18-7eee602f5143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31fe0fd-67ff-49c0-843f-0c9b66575c47', 'volume_name': 'volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3002080e-e5ba-4c92-bb87-bc9e0bdf572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3002080e-e5ba-4c92-bb87-bc9e0bdf572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f9367f-db0f-4ff9-932b-a616a5bff78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:40 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Volume c31fe0fd-67ff-49c0-843f-0c9b66575c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47', 'volume_size': 1} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-193991489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31fe0fd-67ff-49c0-843f-0c9b66575c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550efad104a948b0899845d2d2c6cb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:40Z,use_quota=True,user_id='c6cef664d42d4fe1814602af166bc8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Creating volume c31fe0fd-67ff-49c0-843f-0c9b66575c47 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:40 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:40 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 1073741824 Aug 19 00:13:40 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:40 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.405s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:40 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc Aug 19 00:13:40 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:41 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 1073741824" returned: 0 in 0.559s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:41 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:41 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 Aug 19 00:13:41 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de.84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" returned: 0 in 0.315s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-84c5da30-0e05-4c96-8cdf-14dd8ac12dfc" released by "_delete_snapshot" :: held 1.870s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" released by "delete_snapshot" :: held 1.915s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Created reservations ['2a2f7e90-cbb8-46c7-8a0f-9417543eb92c', '13de9644-6a77-4915-b49a-f0673e9869f4', 'a6d9e5e6-f0a4-4eba-8242-33da84a1f828', '7f53b3b4-c926-49b5-bcbd-038b43abfa44'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Delete snapshot completed successfully. Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-84c5da30-0e05-4c96-8cdf-14dd8ac12dfc-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Snapshots deleted, issuing volume delete {{(pid=94243) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[272dfa1f-4b79-42c1-8276-7cf7549bdad7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:41 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f9367f-db0f-4ff9-932b-a616a5bff78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a615da5-5b5d-4294-82ef-7471a08d1f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:41 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Volume volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 (c31fe0fd-67ff-49c0-843f-0c9b66575c47): created successfully Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a615da5-5b5d-4294-82ef-7471a08d1f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Flow 'volume_create_manager' (d45a5567-3269-4a1e-864f-476edcefb251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c5a27bc5-ef85-4348-9f6b-aa0315146487 tempest-VolumesTransfersV357Test-703136865 None] Created volume successfully. Aug 19 00:13:41 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de Aug 19 00:13:41 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:41 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:41 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de Aug 19 00:13:41 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:42 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" returned: 0 in 0.342s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-2cdd75a6-6f4d-41ae-94b5-2b681ec887de" released by "delete_volume" :: held 0.857s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Created reservations ['9fb28993-a31c-49cd-8593-e25985ce88e0', 'c4c855ea-7fee-4e07-b628-fce223fb0d80', '6ac975f8-8fdc-4f22-bc79-1e18c1fa7a4b', '13ca218a-5716-40e7-b804-8ee0f028be69'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:42 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:42 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:42 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.479s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Deleted volume successfully. Aug 19 00:13:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d13e9197-3ef4-45fc-a945-0174b9b20967 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-2cdd75a6-6f4d-41ae-94b5-2b681ec887de-delete_volume" released by "delete_volume" :: held 6.017s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Flow 'volume_create_manager' (a8694f36-a252-4d45-9f2e-35bb7b1a0a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c27a4da-a72f-480f-a081-449eb18da5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c27a4da-a72f-480f-a081-449eb18da5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-67038039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694325f6-9e2f-4cd0-abe5-f447c6861279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c17d65394f74b0d9778c1a0432a32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:43Z,use_quota=True,user_id='1363fbcb72454911bca19f37b1f63223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c28d35f-32e1-4a09-86ce-2680a03ef30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c28d35f-32e1-4a09-86ce-2680a03ef30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33142cfc-5f6b-48b0-b908-4fd6841b028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33142cfc-5f6b-48b0-b908-4fd6841b028a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694325f6-9e2f-4cd0-abe5-f447c6861279', 'volume_name': 'volume-694325f6-9e2f-4cd0-abe5-f447c6861279', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6462f3-3edc-4052-8b8b-8de901eda527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6462f3-3edc-4052-8b8b-8de901eda527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e83496-e5e7-4536-bd5b-e827c2cd9bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:43 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Volume 694325f6-9e2f-4cd0-abe5-f447c6861279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694325f6-9e2f-4cd0-abe5-f447c6861279', 'volume_size': 1} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-67038039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694325f6-9e2f-4cd0-abe5-f447c6861279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c17d65394f74b0d9778c1a0432a32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:43Z,use_quota=True,user_id='1363fbcb72454911bca19f37b1f63223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Creating volume 694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:43 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:43 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 1073741824 Aug 19 00:13:43 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2d4edd5c-f6fb-4fad-a1a0-070f64b30ec4 tempest-VolumesTransfersV357Test-347548217 None] Transfer volume completed successfully. Aug 19 00:13:44 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 1073741824" returned: 0 in 0.530s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:44 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 Aug 19 00:13:44 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:44 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279" returned: 0 in 0.341s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e83496-e5e7-4536-bd5b-e827c2cd9bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694325f6-9e2f-4cd0-abe5-f447c6861279', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e198598-6bef-4b0d-b7f4-91ef1ab19067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Volume volume-694325f6-9e2f-4cd0-abe5-f447c6861279 (694325f6-9e2f-4cd0-abe5-f447c6861279): created successfully Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e198598-6bef-4b0d-b7f4-91ef1ab19067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Flow 'volume_create_manager' (a8694f36-a252-4d45-9f2e-35bb7b1a0a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7f53482f-44b3-4615-8100-b7ccc10c0688 tempest-VolumesDeleteCascade-271508391 None] Created volume successfully. Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Acquiring lock "cinder-c31fe0fd-67ff-49c0-843f-0c9b66575c47-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-c31fe0fd-67ff-49c0-843f-0c9b66575c47-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Acquiring lock "cinder-quobyte-c31fe0fd-67ff-49c0-843f-0c9b66575c47" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-quobyte-c31fe0fd-67ff-49c0-843f-0c9b66575c47" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d6cd92-a7e0-40fd-ab7f-d52e39a6209b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:45 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 Aug 19 00:13:45 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:45 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47" returned: 0 in 0.403s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:45 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47 Aug 19 00:13:45 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:45 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c31fe0fd-67ff-49c0-843f-0c9b66575c47" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-quobyte-c31fe0fd-67ff-49c0-843f-0c9b66575c47" released by "delete_volume" :: held 0.714s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Created reservations ['515b8622-7560-47bb-8335-3b5a70095823', '7030822c-a020-4759-a216-6c5e2607a556', '7f32c2e7-8738-45cf-9cb6-964151c27a29', '2ce19222-47ab-4c59-b586-aee3c004dbd9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:45 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:45 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Creating offline snapshot 7b92f0f1-e473-4ebc-98cc-0c2278cd0cba of volume 694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4890f28-8a0f-4e64-90d2-7ca0ca84cf2f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:46 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 Aug 19 00:13:46 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:46 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.359s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Deleted volume successfully. Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e42cc345-b6d8-409e-b3c2-6ba49883dd4e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-c31fe0fd-67ff-49c0-843f-0c9b66575c47-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:46 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279" returned: 0 in 0.548s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:46 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba 1G Aug 19 00:13:46 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Flow 'volume_create_manager' (433f9e31-d385-487a-b6a3-ad25b4233317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79b38f3-2a2c-43b7-a41a-59068a5469cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79b38f3-2a2c-43b7-a41a-59068a5469cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1862552026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e619cd-0ded-413d-8ba8-66cbc8f3d391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb7b60e44314a169651fecdc38c49c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:46Z,use_quota=True,user_id='4507491355884db09009d88af7f6cff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328a627c-020c-40d4-87b1-02769b0a05fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328a627c-020c-40d4-87b1-02769b0a05fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd9d637-dfa2-463e-9b60-4f194bec331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd9d637-dfa2-463e-9b60-4f194bec331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e619cd-0ded-413d-8ba8-66cbc8f3d391', 'volume_name': 'volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16621341-42b1-41c8-89d7-adc96a8287d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16621341-42b1-41c8-89d7-adc96a8287d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61575b14-36d1-46d6-baf8-4ff21fd69fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Volume 09e619cd-0ded-413d-8ba8-66cbc8f3d391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391', 'volume_size': 1} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Flow 'volume_create_manager' (ebaf11c4-8725-43a2-9ff9-0e10c0e53978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dfb0c2-5e30-49ce-a265-2dc9622a237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dfb0c2-5e30-49ce-a265-2dc9622a237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-141957584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550efad104a948b0899845d2d2c6cb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:47Z,use_quota=True,user_id='c6cef664d42d4fe1814602af166bc8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926d1db3-0b95-4d5d-83fd-f9758ba5647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926d1db3-0b95-4d5d-83fd-f9758ba5647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b8bf9f-4ff9-4a4a-a3e6-90e1b689480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b8bf9f-4ff9-4a4a-a3e6-90e1b689480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a', 'volume_name': 'volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3ac33f-e9f9-4675-ac33-feb8e38983bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3ac33f-e9f9-4675-ac33-feb8e38983bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488bb18d-aa6a-4048-9e07-e5fb5499cee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Volume 9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a', 'volume_size': 1} Aug 19 00:13:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:47 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba 1G" returned: 0 in 0.582s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694325f6-9e2f-4cd0-abe5-f447c6861279 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:47 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694325f6-9e2f-4cd0-abe5-f447c6861279 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba Aug 19 00:13:47 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:47 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694325f6-9e2f-4cd0-abe5-f447c6861279 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:47 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba is being set with open permissions: ugo+rw Aug 19 00:13:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:47 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba Aug 19 00:13:47 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:47 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:47 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info Aug 19 00:13:47 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:48 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info" returned: 0 in 0.294s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:48 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info is being set with open permissions: ugo+rw Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:48 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info Aug 19 00:13:48 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:48 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.info" returned: 0 in 0.256s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1862552026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e619cd-0ded-413d-8ba8-66cbc8f3d391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb7b60e44314a169651fecdc38c49c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:46Z,use_quota=True,user_id='4507491355884db09009d88af7f6cff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Creating volume 09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:48 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:48 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 1073741824 Aug 19 00:13:48 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8bf5cf3a-2395-47dc-b29f-d385d8e0120b tempest-VolumesDeleteCascade-271508391 None] Create snapshot completed successfully Aug 19 00:13:48 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 1073741824" returned: 0 in 0.493s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=99,cinder:UPDATE=106,cinder:DELETE=11,cinder:INSERT=24 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:13:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:48 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 Aug 19 00:13:48 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:49 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391" returned: 0 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.331s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-141957584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='550efad104a948b0899845d2d2c6cb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:47Z,use_quota=True,user_id='c6cef664d42d4fe1814602af166bc8d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Creating volume 9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:49 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61575b14-36d1-46d6-baf8-4ff21fd69fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:49 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a 1073741824 Aug 19 00:13:49 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fd7547-8e87-419e-839d-e745255462b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Volume volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 (09e619cd-0ded-413d-8ba8-66cbc8f3d391): created successfully Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fd7547-8e87-419e-839d-e745255462b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Flow 'volume_create_manager' (433f9e31-d385-487a-b6a3-ad25b4233317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:49 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=112,cinder:SELECT=86,cinder:INSERT=29,cinder:DELETE=9 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:13:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-d10adf04-7ae5-40dd-b2a2-15f0db6e688c req-df524e42-a36c-4114-b4bb-cbbf9f4b306a tempest-VolumesSnapshotsTestJSON-1277983475 None] Created volume successfully. Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Flow 'volume_create_manager' (3fb79bb6-8d77-4cc4-a212-533ce1d99ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cedf9ca-9ebd-430b-8859-29c31cc465ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cedf9ca-9ebd-430b-8859-29c31cc465ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-111792101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d268da-5d84-437d-b7bd-94ef0fb88c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c17d65394f74b0d9778c1a0432a32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b92f0f1-e473-4ebc-98cc-0c2278cd0cba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:13:50Z,use_quota=True,user_id='1363fbcb72454911bca19f37b1f63223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5227c0f-1b55-4ede-9fa0-b4240e165df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5227c0f-1b55-4ede-9fa0-b4240e165df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adfd21b-083a-45c5-a1bf-06782c07da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:50 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adfd21b-083a-45c5-a1bf-06782c07da2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12d268da-5d84-437d-b7bd-94ef0fb88c30', 'volume_name': 'volume-12d268da-5d84-437d-b7bd-94ef0fb88c30', 'volume_size': 1, 'snapshot_id': '7b92f0f1-e473-4ebc-98cc-0c2278cd0cba'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dde903-1a95-4d5e-93a2-ef277719fce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dde903-1a95-4d5e-93a2-ef277719fce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1bcd90-f330-477f-8911-9b8e0bc7468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Volume 12d268da-5d84-437d-b7bd-94ef0fb88c30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12d268da-5d84-437d-b7bd-94ef0fb88c30', 'volume_size': 1, 'snapshot_id': '7b92f0f1-e473-4ebc-98cc-0c2278cd0cba'} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a 1073741824" returned: 0 in 0.949s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:50 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a Aug 19 00:13:50 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:50 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a" returned: 0 in 0.423s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.476s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba-12d268da-5d84-437d-b7bd-94ef0fb88c30" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488bb18d-aa6a-4048-9e07-e5fb5499cee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffb725f-25e0-4b90-8714-f8c93a24077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba-12d268da-5d84-437d-b7bd-94ef0fb88c30" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Creating volume 12d268da-5d84-437d-b7bd-94ef0fb88c30 from snapshot 7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-12d268da-5d84-437d-b7bd-94ef0fb88c30" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Volume volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a (9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a): created successfully Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffb725f-25e0-4b90-8714-f8c93a24077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Flow 'volume_create_manager' (ebaf11c4-8725-43a2-9ff9-0e10c0e53978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-12d268da-5d84-437d-b7bd-94ef0fb88c30" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] snapshot: 7b92f0f1-e473-4ebc-98cc-0c2278cd0cba, volume: 12d268da-5d84-437d-b7bd-94ef0fb88c30, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:13:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a6f8ede4-cc07-44d6-8772-b2052e146f84 tempest-VolumesTransfersV357Test-703136865 None] Created volume successfully. Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5392922d-111c-49a0-bd13-bcaac89fba27]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:50 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba Aug 19 00:13:50 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:51 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" returned: 0 in 0.409s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694325f6-9e2f-4cd0-abe5-f447c6861279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d27a038-5d6c-4ee0-b71f-44e1b888bc8b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:51 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 Aug 19 00:13:51 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Acquiring lock "cinder-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Acquiring lock "cinder-quobyte-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-quobyte-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d497c077-92c7-467c-9711-8918dd9de33d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:51 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279" returned: 0 in 0.516s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:13:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:51 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 Aug 19 00:13:51 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:51 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a Aug 19 00:13:51 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:52 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a" returned: 0 in 0.567s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:52 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a Aug 19 00:13:52 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:52 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a" returned: 0 in 0.487s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-quobyte-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a" released by "delete_volume" :: held 1.147s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Created reservations ['ed13db9a-917f-47fb-aea6-cd5e84eca14d', '8652e2eb-29f4-4753-88e2-1a31540170c7', 'bf092d80-6e6e-4f11-9670-8ae27e604b49', '2a657344-f6d5-4c3b-ab25-b7eb05e095a1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:53 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:13:53 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:54 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 1.060s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:54 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:13:54 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Deleted volume successfully. Aug 19 00:13:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a39639b1-b963-43cd-8919-b22fc6522e2e tempest-VolumesTransfersV357Test-1113819251 None] Lock "cinder-9ce2f06d-bf7b-4bcd-9ad5-e779da8e2c5a-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:59 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30" returned: 0 in 7.367s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:13:59 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Converted 1024.00 MB image at 138.96 MB/s Aug 19 00:13:59 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 is being set with open permissions: ugo+rw Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:59 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 Aug 19 00:13:59 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:13:59 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30" returned: 0 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-12d268da-5d84-437d-b7bd-94ef0fb88c30" released by "_copy_volume_from_snapshot" :: held 8.741s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba-12d268da-5d84-437d-b7bd-94ef0fb88c30" released by "_create_volume_from_snapshot" :: held 8.849s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.907s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.285s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Creating offline snapshot 92083da3-951e-4725-a8ad-e01c73bd0283 of volume 09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1bcd90-f330-477f-8911-9b8e0bc7468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d268da-5d84-437d-b7bd-94ef0fb88c30', 'volume_size': 1, 'snapshot_id': '7b92f0f1-e473-4ebc-98cc-0c2278cd0cba'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6401d-bc2f-449b-b183-a8ed0f207a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[884da348-6f99-45d3-96a2-fa0c83e602a0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:13:59 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Volume volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 (12d268da-5d84-437d-b7bd-94ef0fb88c30): created successfully Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6401d-bc2f-449b-b183-a8ed0f207a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:13:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Flow 'volume_create_manager' (3fb79bb6-8d77-4cc4-a212-533ce1d99ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:13:59 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-10d058ef-33e8-437b-b6f8-ee4e78bf5711 tempest-VolumesDeleteCascade-271508391 None] Created volume successfully. Aug 19 00:13:59 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 Aug 19 00:13:59 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:00 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391" returned: 0 in 0.508s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:00 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 1G Aug 19 00:14:00 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-694325f6-9e2f-4cd0-abe5-f447c6861279-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-694325f6-9e2f-4cd0-abe5-f447c6861279-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Performing cascade delete. {{(pid=94243) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-694325f6-9e2f-4cd0-abe5-f447c6861279" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-694325f6-9e2f-4cd0-abe5-f447c6861279" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Deleting offline snapshot 7b92f0f1-e473-4ebc-98cc-0c2278cd0cba of volume 694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] snapshot_file for this snap is: volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1d563-0ab9-4eef-855e-72db806db3b4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:00 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba Aug 19 00:14:00 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:00 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 1G" returned: 0 in 0.639s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:00 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 Aug 19 00:14:00 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:01 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" returned: 0 in 0.490s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694325f6-9e2f-4cd0-abe5-f447c6861279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed5846a-87e3-4282-a3c1-a2351a1ab29d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:01 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:01 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 is being set with open permissions: ugo+rw Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:01 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 Aug 19 00:14:01 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:01 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 Aug 19 00:14:01 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:01 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283" returned: 0 in 0.325s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:01 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info Aug 19 00:14:01 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:01 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279" returned: 0 in 0.654s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:01 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba Aug 19 00:14:01 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:02 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info" returned: 0 in 0.332s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:02 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info is being set with open permissions: ugo+rw Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:02 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info Aug 19 00:14:02 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:02 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:02 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba Aug 19 00:14:02 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:02 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.info" returned: 0 in 0.391s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-b8309948-aa2b-488c-a9fe-7d17a96f17b3 req-66768026-35a8-45e3-a34f-a0e2a6576e1e tempest-VolumesSnapshotsTestJSON-1277983475 None] Create snapshot completed successfully Aug 19 00:14:02 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279.7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" returned: 0 in 0.279s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba" released by "_delete_snapshot" :: held 1.998s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-694325f6-9e2f-4cd0-abe5-f447c6861279" released by "delete_snapshot" :: held 2.030s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Created reservations ['490464aa-82c3-4007-aadc-1334d9110306', '84b7fa28-bf8f-4da9-934f-09f93154e8fb', 'f627af2c-c321-466e-a4eb-4d5847144000', '1bb26ed0-a5ea-4710-be85-c341dd5710a7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Delete snapshot completed successfully. Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-7b92f0f1-e473-4ebc-98cc-0c2278cd0cba-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Snapshots deleted, issuing volume delete {{(pid=94243) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-694325f6-9e2f-4cd0-abe5-f447c6861279" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-694325f6-9e2f-4cd0-abe5-f447c6861279" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba4f42-b66f-4f37-bc43-316b97e0fb18]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:03 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 Aug 19 00:14:03 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "cinder-92083da3-951e-4725-a8ad-e01c73bd0283-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-92083da3-951e-4725-a8ad-e01c73bd0283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "cinder-quobyte-09e619cd-0ded-413d-8ba8-66cbc8f3d391" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:03 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279" returned: 0 in 0.461s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-quobyte-09e619cd-0ded-413d-8ba8-66cbc8f3d391" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "cinder-quobyte-92083da3-951e-4725-a8ad-e01c73bd0283" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-quobyte-92083da3-951e-4725-a8ad-e01c73bd0283" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:03 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279 Aug 19 00:14:03 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Deleting offline snapshot 92083da3-951e-4725-a8ad-e01c73bd0283 of volume 09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] snapshot_file for this snap is: volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b9dcf-244f-408d-86e1-513236a7649b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:03 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 Aug 19 00:14:03 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:03 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694325f6-9e2f-4cd0-abe5-f447c6861279" returned: 0 in 0.352s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-694325f6-9e2f-4cd0-abe5-f447c6861279" released by "delete_volume" :: held 0.883s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Created reservations ['9b2c0af0-f02d-4cd8-b101-b6f0f71e51b5', 'cd7eef01-42e6-4efc-9cb4-4dac340bb54d', '816d9214-5787-4b00-8b5c-f3dec85c8351', 'f065626a-8993-4621-8bd8-243aa1a667bb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:03 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283" returned: 0 in 0.484s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd149d-9b72-4db9-80fe-72e931929ff7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:04 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:04 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:04 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 Aug 19 00:14:04 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:04 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.357s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Deleted volume successfully. Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5560ea3c-6b28-46d1-b045-80cff515874b tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-694325f6-9e2f-4cd0-abe5-f447c6861279-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:04 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391" returned: 0 in 0.548s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:04 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 Aug 19 00:14:04 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:04 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:04 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283 Aug 19 00:14:04 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-12d268da-5d84-437d-b7bd-94ef0fb88c30-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-12d268da-5d84-437d-b7bd-94ef0fb88c30-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "cinder-quobyte-12d268da-5d84-437d-b7bd-94ef0fb88c30" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-12d268da-5d84-437d-b7bd-94ef0fb88c30" acquired by "delete_volume" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:05 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391.92083da3-951e-4725-a8ad-e01c73bd0283" returned: 0 in 0.357s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[75256558-ae29-43dd-82a2-ab450689acf0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-quobyte-92083da3-951e-4725-a8ad-e01c73bd0283" released by "_delete_snapshot" :: held 1.957s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-quobyte-09e619cd-0ded-413d-8ba8-66cbc8f3d391" released by "delete_snapshot" :: held 1.998s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:05 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 Aug 19 00:14:05 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.quota [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Created reservations ['c508b6d9-0532-4ba3-9ffe-5f2841ff256e', '2028b212-7148-4741-bd3e-528a6541cdff', 'e695579d-6ad4-464f-a446-7368a5047159', '86b7a6c9-1538-4f04-8746-a19d95631d40'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:05 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Delete snapshot completed successfully. Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-b0e2839b-be1b-42df-a2cb-06c07564cfbf req-b53f8a58-e784-4efd-892d-114feca99201 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-92083da3-951e-4725-a8ad-e01c73bd0283-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "cinder-09e619cd-0ded-413d-8ba8-66cbc8f3d391-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-09e619cd-0ded-413d-8ba8-66cbc8f3d391-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "cinder-quobyte-09e619cd-0ded-413d-8ba8-66cbc8f3d391" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-quobyte-09e619cd-0ded-413d-8ba8-66cbc8f3d391" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:05 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30" returned: 0 in 0.462s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8102189-0870-4623-a33e-b61c536a4fc0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:05 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30 Aug 19 00:14:05 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:05 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 Aug 19 00:14:05 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:06 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-12d268da-5d84-437d-b7bd-94ef0fb88c30" returned: 0 in 0.303s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-quobyte-12d268da-5d84-437d-b7bd-94ef0fb88c30" released by "delete_volume" :: held 0.822s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Created reservations ['9e82c2ce-3175-4320-a1b3-07500255cbed', '88cad8a7-fd80-47b7-ba0d-60373dad941c', 'a5d0d828-937c-4e66-b43d-1a426b7cda9e', 'e3475460-a677-4ee8-9216-2593ee802a04'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:06 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391" returned: 0 in 0.401s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:06 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391 Aug 19 00:14:06 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:06 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:06 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:06 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-09e619cd-0ded-413d-8ba8-66cbc8f3d391" returned: 0 in 0.274s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-quobyte-09e619cd-0ded-413d-8ba8-66cbc8f3d391" released by "delete_volume" :: held 0.773s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.quota [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Created reservations ['2b78e2ac-b445-4c8b-b295-193306bf3746', '0da8869d-a43a-46ac-9cee-f93876f4bf43', 'c5baa578-5a49-4723-8a47-9cd3c4e49dc5', '10a0204f-14f5-4895-8878-965a52c60235'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:06 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.354s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:06 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Deleted volume successfully. Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e19dc6cf-857b-4638-9eea-d0ff60f94cbd tempest-VolumesDeleteCascade-271508391 None] Lock "cinder-12d268da-5d84-437d-b7bd-94ef0fb88c30-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:06 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:06 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:07 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.311s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:07 devstack cinder-volume[94243]: DEBUG cinder.manager [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Deleted volume successfully. Aug 19 00:14:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1142a00b-5174-4771-9aad-4924c44d8bb2 req-ade998c9-81c9-469b-8f10-824d4345a661 tempest-VolumesSnapshotsTestJSON-1277983475 None] Lock "cinder-09e619cd-0ded-413d-8ba8-66cbc8f3d391-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Flow 'volume_create_manager' (446bce75-d367-4bfe-a9c2-6bfea1fbc18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3f8180-425d-4721-ae6a-042901952ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3f8180-425d-4721-ae6a-042901952ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1813101889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70352c3b-684f-4b6a-8c1a-0f220c7d7965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6746fac9404b219a1c9c8569d8d99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:12Z,use_quota=True,user_id='11e7b21642f74c8a80b0dabac0d4b260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dca96af-b589-47ee-aa9f-b9c2738cbcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dca96af-b589-47ee-aa9f-b9c2738cbcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4087cb2f-4a14-453b-aeb1-7e9a7d35746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4087cb2f-4a14-453b-aeb1-7e9a7d35746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70352c3b-684f-4b6a-8c1a-0f220c7d7965', 'volume_name': 'volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd89f71-fae5-4d9c-a6b6-a96fbcd98029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd89f71-fae5-4d9c-a6b6-a96fbcd98029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b9dfd3-53ff-4bf3-b0a7-db34429b2ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Volume 70352c3b-684f-4b6a-8c1a-0f220c7d7965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965', 'volume_size': 1} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1813101889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70352c3b-684f-4b6a-8c1a-0f220c7d7965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6746fac9404b219a1c9c8569d8d99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:12Z,use_quota=True,user_id='11e7b21642f74c8a80b0dabac0d4b260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Creating volume 70352c3b-684f-4b6a-8c1a-0f220c7d7965 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:12 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:12 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 1073741824 Aug 19 00:14:12 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Flow 'volume_create_manager' (b1b47156-f578-48b9-b918-d1cd9f8fd63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a2fbea-869b-405b-a4aa-e51f6d4850f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a2fbea-869b-405b-a4aa-e51f6d4850f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1666764844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc584615-55c8-4dc4-8e3b-cb781a34b4f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02254b867e7a41b89b25ed4f6f40c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:13Z,use_quota=True,user_id='71287e8e385b496eb268dfdfc92b7ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce1f65c-d014-45b5-86e1-2bdc1537cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce1f65c-d014-45b5-86e1-2bdc1537cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f9e84-4c16-4aef-ace7-7f50afa45b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f9e84-4c16-4aef-ace7-7f50afa45b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc584615-55c8-4dc4-8e3b-cb781a34b4f9', 'volume_name': 'volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0f7430-4cca-4e8e-b434-b84957aed7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0f7430-4cca-4e8e-b434-b84957aed7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59ee6d4-de11-4a6b-b264-8ad6d168457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Volume fc584615-55c8-4dc4-8e3b-cb781a34b4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9', 'volume_size': 1} Aug 19 00:14:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:13 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 1073741824" returned: 0 in 0.555s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:13 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 Aug 19 00:14:13 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:13 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965" returned: 0 in 0.279s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:13 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:13 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1666764844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc584615-55c8-4dc4-8e3b-cb781a34b4f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02254b867e7a41b89b25ed4f6f40c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:13Z,use_quota=True,user_id='71287e8e385b496eb268dfdfc92b7ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Creating volume fc584615-55c8-4dc4-8e3b-cb781a34b4f9 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:13 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:13 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 1073741824 Aug 19 00:14:13 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b9dfd3-53ff-4bf3-b0a7-db34429b2ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb6f36d-81c3-4feb-beff-8da40e80da3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:13 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Volume volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 (70352c3b-684f-4b6a-8c1a-0f220c7d7965): created successfully Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb6f36d-81c3-4feb-beff-8da40e80da3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Flow 'volume_create_manager' (446bce75-d367-4bfe-a9c2-6bfea1fbc18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9871c18d-f9c2-46ce-9eee-bad905adffab tempest-VolumesTransfersV355Test-1840867362 None] Created volume successfully. Aug 19 00:14:13 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.303s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:14:13 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 1073741824" returned: 0 in 0.557s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:14 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 Aug 19 00:14:14 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:14 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9" returned: 0 in 0.260s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59ee6d4-de11-4a6b-b264-8ad6d168457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5582761-2015-46f6-8ca1-79068b9a23d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Volume volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 (fc584615-55c8-4dc4-8e3b-cb781a34b4f9): created successfully Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5582761-2015-46f6-8ca1-79068b9a23d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Flow 'volume_create_manager' (b1b47156-f578-48b9-b918-d1cd9f8fd63e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:14 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7a4901d1-81da-4fe7-a8b8-fb867e6002bb tempest-VolumesTestJSON-1081330062 None] Created volume successfully. Aug 19 00:14:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a05f0fb4-9d4e-453d-8f7d-40b3eb44d22b tempest-VolumesTransfersV355Test-77972945 None] Transfer volume completed successfully. Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Flow 'volume_create_manager' (a0c74e08-f552-4900-8be4-1af821fba206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1f0051-88c0-4ba8-ad91-df8e3cca315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Acquiring lock "cinder-70352c3b-684f-4b6a-8c1a-0f220c7d7965-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1f0051-88c0-4ba8-ad91-df8e3cca315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-661682750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1e57df-8df6-4e5a-828b-70903ba844ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02254b867e7a41b89b25ed4f6f40c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:16Z,use_quota=True,user_id='71287e8e385b496eb268dfdfc92b7ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4425ef37-3697-44c6-b095-f833c3d3c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4425ef37-3697-44c6-b095-f833c3d3c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebfa677-1eb5-4940-96d8-cf3557ff3f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebfa677-1eb5-4940-96d8-cf3557ff3f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1e57df-8df6-4e5a-828b-70903ba844ff', 'volume_name': 'volume-af1e57df-8df6-4e5a-828b-70903ba844ff', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda4dd61-2b0a-4fd3-8e40-ce9a096df316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda4dd61-2b0a-4fd3-8e40-ce9a096df316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fc2ed9-31f9-43c5-803c-d5b71125d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Volume af1e57df-8df6-4e5a-828b-70903ba844ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1e57df-8df6-4e5a-828b-70903ba844ff', 'volume_size': 1} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-661682750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1e57df-8df6-4e5a-828b-70903ba844ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02254b867e7a41b89b25ed4f6f40c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:16Z,use_quota=True,user_id='71287e8e385b496eb268dfdfc92b7ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Creating volume af1e57df-8df6-4e5a-828b-70903ba844ff {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:15 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-70352c3b-684f-4b6a-8c1a-0f220c7d7965-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:15 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff 1073741824 Aug 19 00:14:15 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Acquiring lock "cinder-quobyte-70352c3b-684f-4b6a-8c1a-0f220c7d7965" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-quobyte-70352c3b-684f-4b6a-8c1a-0f220c7d7965" acquired by "delete_volume" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b43fb-b44a-4b21-93c3-e691be870e41]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:16 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 Aug 19 00:14:16 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:16 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff 1073741824" returned: 0 in 0.543s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:16 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:16 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965 Aug 19 00:14:16 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:16 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff Aug 19 00:14:16 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:16 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-70352c3b-684f-4b6a-8c1a-0f220c7d7965" returned: 0 in 0.390s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-quobyte-70352c3b-684f-4b6a-8c1a-0f220c7d7965" released by "delete_volume" :: held 0.908s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:16 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff" returned: 0 in 0.390s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70fc2ed9-31f9-43c5-803c-d5b71125d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1e57df-8df6-4e5a-828b-70903ba844ff', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbf8756-4ce7-4ed2-af85-7785a7d91b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:16 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Volume volume-af1e57df-8df6-4e5a-828b-70903ba844ff (af1e57df-8df6-4e5a-828b-70903ba844ff): created successfully Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dbf8756-4ce7-4ed2-af85-7785a7d91b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Flow 'volume_create_manager' (a0c74e08-f552-4900-8be4-1af821fba206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e77f0823-da67-47d3-9262-4b5a9444cb3e tempest-VolumesTestJSON-1081330062 None] Created volume successfully. Aug 19 00:14:16 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Created reservations ['80bf0940-9908-4624-9741-e2e7cabe5f77', '2db1b871-cb04-4a22-8902-9288529074c9', '53fbe816-c175-47db-9d0d-8fe3e69faab1', '966562a3-2db5-45bb-983a-4683e45700bc'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:17 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:17 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:17 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Deleted volume successfully. Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7e3a51df-0876-4cc9-b632-c226813635d7 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-70352c3b-684f-4b6a-8c1a-0f220c7d7965-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Flow 'volume_create_manager' (ab8431cc-7fc0-448e-9cdb-9a12aa286972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693662f6-c142-442a-9fbf-48de41c82bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693662f6-c142-442a-9fbf-48de41c82bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216872081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bbb658-ee5a-4b0c-9681-2aa741db5fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c0cd5748084a6f8ea5ced35e65a4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:17Z,use_quota=True,user_id='ccb36750d0194f12877dac08dd66d3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8712a4df-1c5b-43d9-8618-f178d692f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8712a4df-1c5b-43d9-8618-f178d692f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f459355d-90d3-4c8b-9ca3-da313cb25486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f459355d-90d3-4c8b-9ca3-da313cb25486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bbb658-ee5a-4b0c-9681-2aa741db5fd5', 'volume_name': 'volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ee9e6d-90c9-434d-bf57-3d0100618f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ee9e6d-90c9-434d-bf57-3d0100618f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715655ef-bc47-4b3b-9664-0b0b6e8692c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Volume f8bbb658-ee5a-4b0c-9681-2aa741db5fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5', 'volume_size': 1} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216872081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bbb658-ee5a-4b0c-9681-2aa741db5fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c0cd5748084a6f8ea5ced35e65a4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:17Z,use_quota=True,user_id='ccb36750d0194f12877dac08dd66d3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Creating volume f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:17 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:17 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 1073741824 Aug 19 00:14:17 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:18 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 1073741824" returned: 0 in 0.568s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:18 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:14:18 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:18 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.479s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Flow 'volume_create_manager' (d8046045-e08c-41bc-bd84-d9a6d4d432c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35a3145-27ce-4ed7-9d05-6f3de7f5045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715655ef-bc47-4b3b-9664-0b0b6e8692c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bf7f93-515a-453a-9504-46e34e3c8768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35a3145-27ce-4ed7-9d05-6f3de7f5045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-181853351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02254b867e7a41b89b25ed4f6f40c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:19Z,use_quota=True,user_id='71287e8e385b496eb268dfdfc92b7ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5715c9-8070-43b9-a11b-dd7f28ce84d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5715c9-8070-43b9-a11b-dd7f28ce84d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b208d6-9d75-4fb8-89a4-e728a66d51cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b208d6-9d75-4fb8-89a4-e728a66d51cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b', 'volume_name': 'volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f88da1-4499-4f71-ae00-58ec972a52f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4f88da1-4499-4f71-ae00-58ec972a52f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257910f5-0b68-419d-8fef-28e04e70b4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:18 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Volume e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b', 'volume_size': 1} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-181853351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02254b867e7a41b89b25ed4f6f40c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:19Z,use_quota=True,user_id='71287e8e385b496eb268dfdfc92b7ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Creating volume e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:18 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:18 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b 1073741824 Aug 19 00:14:18 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:18 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Volume volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 (f8bbb658-ee5a-4b0c-9681-2aa741db5fd5): created successfully Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bf7f93-515a-453a-9504-46e34e3c8768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Flow 'volume_create_manager' (ab8431cc-7fc0-448e-9cdb-9a12aa286972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1cb8dee3-8ce0-46b9-95a8-02378e7c6cf9 tempest-VolumesActionsTest-1267328008 None] Created volume successfully. Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Flow 'volume_create_manager' (4c02de9c-b982-48bc-bfdb-cddc51ecfb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe74591-569f-40eb-83a4-41631e0b1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe74591-569f-40eb-83a4-41631e0b1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-920426241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1068562-1a8b-4397-84ed-802c46eac27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6746fac9404b219a1c9c8569d8d99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:19Z,use_quota=True,user_id='11e7b21642f74c8a80b0dabac0d4b260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c7913e-d811-4077-b762-709307b91c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c7913e-d811-4077-b762-709307b91c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157953cc-24fb-4323-9c28-843914237451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157953cc-24fb-4323-9c28-843914237451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1068562-1a8b-4397-84ed-802c46eac27e', 'volume_name': 'volume-d1068562-1a8b-4397-84ed-802c46eac27e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef92fa1d-d9b8-4c6c-8331-902c1fb46ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef92fa1d-d9b8-4c6c-8331-902c1fb46ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f64ac0-0605-4cbb-87c2-36ec08761bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Volume d1068562-1a8b-4397-84ed-802c46eac27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1068562-1a8b-4397-84ed-802c46eac27e', 'volume_size': 1} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:19 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b 1073741824" returned: 0 in 0.569s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:19 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b Aug 19 00:14:19 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:19 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b" returned: 0 in 0.336s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-920426241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1068562-1a8b-4397-84ed-802c46eac27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6746fac9404b219a1c9c8569d8d99a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:19Z,use_quota=True,user_id='11e7b21642f74c8a80b0dabac0d4b260',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Creating volume d1068562-1a8b-4397-84ed-802c46eac27e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:19 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257910f5-0b68-419d-8fef-28e04e70b4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01b7643-1909-4bfd-b3a0-84c16d72caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:19 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e 1073741824 Aug 19 00:14:19 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Volume volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b (e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b): created successfully Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01b7643-1909-4bfd-b3a0-84c16d72caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Flow 'volume_create_manager' (d8046045-e08c-41bc-bd84-d9a6d4d432c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-920ccabb-9342-4c7c-a143-4e6cc478cd90 tempest-VolumesTestJSON-1081330062 None] Created volume successfully. Aug 19 00:14:20 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e 1073741824" returned: 0 in 0.597s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:20 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e Aug 19 00:14:20 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:20 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e" returned: 0 in 0.380s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f64ac0-0605-4cbb-87c2-36ec08761bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1068562-1a8b-4397-84ed-802c46eac27e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138c68a2-8e61-4b4a-91a4-0a62a4612d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Volume volume-d1068562-1a8b-4397-84ed-802c46eac27e (d1068562-1a8b-4397-84ed-802c46eac27e): created successfully Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138c68a2-8e61-4b4a-91a4-0a62a4612d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Flow 'volume_create_manager' (4c02de9c-b982-48bc-bfdb-cddc51ecfb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-82c3699b-bc58-4af2-a5cb-c38d84bdac27 tempest-VolumesTransfersV355Test-1840867362 None] Created volume successfully. Aug 19 00:14:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Acquiring lock "cinder-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Lock "cinder-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Acquiring lock "cinder-quobyte-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Lock "cinder-quobyte-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a60bba9-f9f6-404b-806f-c9ead4bb174f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:22 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b Aug 19 00:14:22 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Acquiring lock "cinder-d1068562-1a8b-4397-84ed-802c46eac27e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-d1068562-1a8b-4397-84ed-802c46eac27e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:22 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b" returned: 0 in 0.485s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:22 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b Aug 19 00:14:22 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Acquiring lock "cinder-quobyte-d1068562-1a8b-4397-84ed-802c46eac27e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-quobyte-d1068562-1a8b-4397-84ed-802c46eac27e" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c29fca-65ea-423c-b027-b7dfce6fffc7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:22 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e Aug 19 00:14:22 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:22 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b" returned: 0 in 0.430s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Lock "cinder-quobyte-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b" released by "delete_volume" :: held 0.993s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Created reservations ['deeac4ef-c5ed-4e5d-ac00-0e3c1b38faa8', '1c415022-e794-4203-9a7f-962cc4cda56e', 'f29f1b46-a76a-4b3f-a3ab-ba26429eeb5f', 'c7462844-d398-4a51-8daa-4adf8ae12b4e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:23 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e" returned: 0 in 0.612s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:23 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:23 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:23 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e Aug 19 00:14:23 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:23 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.442s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Deleted volume successfully. Aug 19 00:14:23 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d1068562-1a8b-4397-84ed-802c46eac27e" returned: 0 in 0.489s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-quobyte-d1068562-1a8b-4397-84ed-802c46eac27e" released by "delete_volume" :: held 1.173s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39b95f0e-5360-4c7f-b520-fb2dca5471b7 tempest-VolumesTestJSON-1081330062 None] Lock "cinder-e9e511ab-3db0-4ac6-ad14-1b3e2bfad32b-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-d103af8d-579b-4a63-8470-69da49fc22f3 req-6e89c0cc-a73b-4357-9263-afd5f692941d tempest-AttachVolumeNegativeTest-1110771946 None] Terminate volume connection completed successfully. Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-d103af8d-579b-4a63-8470-69da49fc22f3 req-6e89c0cc-a73b-4357-9263-afd5f692941d tempest-AttachVolumeNegativeTest-1110771946 None] Deleting attachment 0ef49790-1b91-4365-b8bd-9fd6da4bd1a5. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Created reservations ['22af93ff-e0c4-4833-9b9a-a68a3f455b19', '51bbc719-ffa5-4d3d-a651-c06be1bde42f', '992bc85e-6f76-421b-a38b-c899fcc69155', '99a37f4f-b0cc-4c39-8f5f-0a2fa7823778'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:23 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:23 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Acquiring lock "cinder-af1e57df-8df6-4e5a-828b-70903ba844ff-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:24 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Lock "cinder-af1e57df-8df6-4e5a-828b-70903ba844ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Deleted volume successfully. Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f925d7a2-f228-483b-92a2-e7d18ed33c82 tempest-VolumesTransfersV355Test-823919732 None] Lock "cinder-d1068562-1a8b-4397-84ed-802c46eac27e-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Acquiring lock "cinder-quobyte-af1e57df-8df6-4e5a-828b-70903ba844ff" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Lock "cinder-quobyte-af1e57df-8df6-4e5a-828b-70903ba844ff" acquired by "delete_volume" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cacd268-5d04-4cd7-a99f-804fc5ae32f7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:24 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff Aug 19 00:14:24 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:24 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff" returned: 0 in 0.388s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:24 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff Aug 19 00:14:24 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:25 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af1e57df-8df6-4e5a-828b-70903ba844ff" returned: 0 in 0.293s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Lock "cinder-quobyte-af1e57df-8df6-4e5a-828b-70903ba844ff" released by "delete_volume" :: held 0.737s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Created reservations ['f0b871f7-f217-4ad0-a682-c40352d17ccc', '9ea5c685-84e7-4620-9102-af7b8ed41745', 'e2cdcb73-0cfc-4074-9e6d-5f42ba1563b0', '270bf58f-ac7d-4b9b-86aa-b49d76565ed1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:25 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:25 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Acquiring lock "cinder-fc584615-55c8-4dc4-8e3b-cb781a34b4f9-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Lock "cinder-fc584615-55c8-4dc4-8e3b-cb781a34b4f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Acquiring lock "cinder-quobyte-fc584615-55c8-4dc4-8e3b-cb781a34b4f9" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Lock "cinder-quobyte-fc584615-55c8-4dc4-8e3b-cb781a34b4f9" acquired by "delete_volume" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f2e6f-5d2f-43dc-9571-2aa9dfdbc34c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:25 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.419s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Deleted volume successfully. Aug 19 00:14:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d793bca-1fab-48bf-bd54-47070d73b24c tempest-VolumesTestJSON-1081330062 None] Lock "cinder-af1e57df-8df6-4e5a-828b-70903ba844ff-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:25 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 Aug 19 00:14:25 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:26 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9" returned: 0 in 0.858s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:26 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9 Aug 19 00:14:26 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:27 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc584615-55c8-4dc4-8e3b-cb781a34b4f9" returned: 0 in 0.676s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Lock "cinder-quobyte-fc584615-55c8-4dc4-8e3b-cb781a34b4f9" released by "delete_volume" :: held 1.618s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Created reservations ['8d1337de-30b0-4cce-bde5-fe85f1892fe8', '572002b7-32b9-409f-83cb-c47ccb168941', 'd40f27d4-cc40-4094-8faf-8f53c25f2c56', '01da4a71-4653-43e6-80d7-bfae5fde6bfb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:27 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:27 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:27 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Deleted volume successfully. Aug 19 00:14:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-73213c57-f57d-4f1a-b55c-fd8ed2178a4b tempest-VolumesTestJSON-1081330062 None] Lock "cinder-fc584615-55c8-4dc4-8e3b-cb781a34b4f9-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36389aea-d7b7-4409-a45f-ad519576b58a tempest-VolumesActionsTest-1267328008 None] Acquiring lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" by "attach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36389aea-d7b7-4409-a45f-ad519576b58a tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" acquired by "attach_volume" :: waited 0.045s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-36389aea-d7b7-4409-a45f-ad519576b58a tempest-VolumesActionsTest-1267328008 None] Attaching volume f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 to instance 0b994297-a95e-40b3-91b3-e2f3f4f6c108 at mountpoint /dev/vdb on host None. Aug 19 00:14:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-36389aea-d7b7-4409-a45f-ad519576b58a tempest-VolumesActionsTest-1267328008 None] Attach volume completed successfully. Aug 19 00:14:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36389aea-d7b7-4409-a45f-ad519576b58a tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" released by "attach_volume" :: held 0.339s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-98f7d706-8fe2-456a-946b-06b53c2434ca tempest-VolumesActionsTest-1267328008 None] Acquiring lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-detach_volume" by "detach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-98f7d706-8fe2-456a-946b-06b53c2434ca tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-98f7d706-8fe2-456a-946b-06b53c2434ca tempest-VolumesActionsTest-1267328008 None] Detaching volume f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 from instance 0b994297-a95e-40b3-91b3-e2f3f4f6c108. Aug 19 00:14:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-98f7d706-8fe2-456a-946b-06b53c2434ca tempest-VolumesActionsTest-1267328008 None] Detach volume completed successfully. Aug 19 00:14:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-98f7d706-8fe2-456a-946b-06b53c2434ca tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e3475b13-f5be-46b2-9aa6-675186d1e389 tempest-BackendsCapabilitiesAdminTestsJSON-1896909973 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953582763672, 'free_capacity_gb': 1775.6953582763672, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94243) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 19 00:14:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-db639477-15ea-40a9-9a23-a448cbb063e5 tempest-BackendsCapabilitiesAdminTestsJSON-1896909973 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953582763672, 'free_capacity_gb': 1775.6953582763672, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94243) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Flow 'volume_create_manager' (ef37c446-44e8-407c-a1e3-a006788168c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2ada33-10e4-4c0a-a104-6c2489601c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2ada33-10e4-4c0a-a104-6c2489601c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1033466314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89db906-08e6-477f-9282-63e633f6bdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77ed6e399a746cc96c0832fab16871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:35Z,use_quota=True,user_id='6f84c5885a374cf2b5cdc9f1036588ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf28043d-538c-47d1-8109-757c5f4fc2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf28043d-538c-47d1-8109-757c5f4fc2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386ac6da-8b3d-4c8d-9570-e8e153c42480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386ac6da-8b3d-4c8d-9570-e8e153c42480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89db906-08e6-477f-9282-63e633f6bdb1', 'volume_name': 'volume-a89db906-08e6-477f-9282-63e633f6bdb1', 'volume_size': 2}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875604b7-9e26-477b-9916-6e683be166b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875604b7-9e26-477b-9916-6e683be166b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028163a0-c7c3-410c-b30a-0aba437eb20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Volume a89db906-08e6-477f-9282-63e633f6bdb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89db906-08e6-477f-9282-63e633f6bdb1', 'volume_size': 2} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1033466314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89db906-08e6-477f-9282-63e633f6bdb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77ed6e399a746cc96c0832fab16871b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:35Z,use_quota=True,user_id='6f84c5885a374cf2b5cdc9f1036588ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Creating volume a89db906-08e6-477f-9282-63e633f6bdb1 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:35 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 2147483648 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:35 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 2147483648 Aug 19 00:14:35 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:36 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 2147483648" returned: 0 in 0.783s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:36 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 Aug 19 00:14:36 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:36 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1" returned: 0 in 0.356s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (028163a0-c7c3-410c-b30a-0aba437eb20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89db906-08e6-477f-9282-63e633f6bdb1', 'volume_size': 2}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9d47b8-41fc-448e-ac7a-6e347e67ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Volume volume-a89db906-08e6-477f-9282-63e633f6bdb1 (a89db906-08e6-477f-9282-63e633f6bdb1): created successfully Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9d47b8-41fc-448e-ac7a-6e347e67ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Flow 'volume_create_manager' (ef37c446-44e8-407c-a1e3-a006788168c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c41e8f21-f6cb-4058-9e4b-18d95219db55 tempest-VolumesCloneNegativeTest-2115937067 None] Created volume successfully. Aug 19 00:14:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Acquiring lock "cinder-a89db906-08e6-477f-9282-63e633f6bdb1-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "cinder-a89db906-08e6-477f-9282-63e633f6bdb1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Acquiring lock "cinder-quobyte-a89db906-08e6-477f-9282-63e633f6bdb1" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "cinder-quobyte-a89db906-08e6-477f-9282-63e633f6bdb1" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbeecc2-2868-4c3b-805f-53fbaef3552a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:38 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 Aug 19 00:14:38 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:38 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1" returned: 0 in 0.479s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:38 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1 Aug 19 00:14:38 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:38 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a89db906-08e6-477f-9282-63e633f6bdb1" returned: 0 in 0.389s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "cinder-quobyte-a89db906-08e6-477f-9282-63e633f6bdb1" released by "delete_volume" :: held 0.931s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Created reservations ['7ec55e05-0dc6-4ee1-81b4-ffeb9bcf51a2', 'b4f9ab25-cfa9-4150-875a-48db2859addb', '6c14f98d-0e19-47d7-912b-4aeb3532afd1', '756d0fc6-363d-4cf3-93da-3610ede3a648'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:39 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:39 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:39 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Deleted volume successfully. Aug 19 00:14:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0b7bfdc1-5ae0-418d-8a2b-0008d2d7e563 tempest-VolumesCloneNegativeTest-2115937067 None] Lock "cinder-a89db906-08e6-477f-9282-63e633f6bdb1-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bafee68b-c441-4188-a797-77ec1c946f11 tempest-GroupSnapshotsV319Test-1686522549 None] Group tempest-GroupSnapshotsV319Test-Group-397473908: creating Aug 19 00:14:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bafee68b-c441-4188-a797-77ec1c946f11 tempest-GroupSnapshotsV319Test-1686522549 None] Group tempest-GroupSnapshotsV319Test-Group-397473908: created successfully Aug 19 00:14:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bafee68b-c441-4188-a797-77ec1c946f11 tempest-GroupSnapshotsV319Test-1686522549 None] Create group completed successfully. Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Flow 'volume_create_manager' (bf904cc6-0fc7-4ef2-aab1-aa99540bd397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f40e98f-d2cc-4482-bdc4-e5bcc68c5907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f40e98f-d2cc-4482-bdc4-e5bcc68c5907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919567090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b050d04e-4381-4e88-b817-abd02bf9e9c6,host='devstack@QuobyteHD#QuobyteHD',id=694d0d64-0714-4a42-902f-39fab75b219e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b710bb68df485e939b0b9f68d66cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:45Z,use_quota=True,user_id='39288ce82a374257b381ad08adf23b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d289e0f-dc3a-4ca6-8c17-b59362b0ffb6),volume_type_id=6d289e0f-dc3a-4ca6-8c17-b59362b0ffb6)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300bc186-71ec-4228-b8a6-6bdcd2c24a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300bc186-71ec-4228-b8a6-6bdcd2c24a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84603588-1cde-4951-b597-a3784ee73a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84603588-1cde-4951-b597-a3784ee73a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694d0d64-0714-4a42-902f-39fab75b219e', 'volume_name': 'volume-694d0d64-0714-4a42-902f-39fab75b219e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3b101b-5719-4f56-a83d-e7153f3f8f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3b101b-5719-4f56-a83d-e7153f3f8f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d696cc84-633d-45a1-aba5-0413026ec56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Volume 694d0d64-0714-4a42-902f-39fab75b219e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694d0d64-0714-4a42-902f-39fab75b219e', 'volume_size': 1} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b050d04e-4381-4e88-b817-abd02bf9e9c6,created_at=2026-08-18T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919567090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b050d04e-4381-4e88-b817-abd02bf9e9c6,host='devstack@QuobyteHD#QuobyteHD',id=694d0d64-0714-4a42-902f-39fab75b219e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b710bb68df485e939b0b9f68d66cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:45Z,use_quota=True,user_id='39288ce82a374257b381ad08adf23b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d289e0f-dc3a-4ca6-8c17-b59362b0ffb6),volume_type_id=6d289e0f-dc3a-4ca6-8c17-b59362b0ffb6)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Creating volume 694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:44 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:44 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e 1073741824 Aug 19 00:14:44 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:45 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e 1073741824" returned: 0 in 0.713s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:45 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e Aug 19 00:14:45 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (018f7017-2855-4b17-a37f-b774752c4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180a1a3c-bb87-45bb-a948-c6f8b81710d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180a1a3c-bb87-45bb-a948-c6f8b81710d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-587866109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb89dbf-3bc1-4a37-9817-25822565f97d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:46Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e600c3-d905-47be-a70f-4feed3484e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e600c3-d905-47be-a70f-4feed3484e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db3fe2a-4db4-4fff-89d9-b2d772e803f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db3fe2a-4db4-4fff-89d9-b2d772e803f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb89dbf-3bc1-4a37-9817-25822565f97d', 'volume_name': 'volume-ecb89dbf-3bc1-4a37-9817-25822565f97d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a8a30b-12bc-45e3-9505-71acacf25ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a8a30b-12bc-45e3-9505-71acacf25ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d031700-98ad-41b0-bc4e-0e5bc00f7003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Volume ecb89dbf-3bc1-4a37-9817-25822565f97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb89dbf-3bc1-4a37-9817-25822565f97d', 'volume_size': 1} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:46 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e" returned: 0 in 0.742s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-587866109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb89dbf-3bc1-4a37-9817-25822565f97d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:46Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Creating volume ecb89dbf-3bc1-4a37-9817-25822565f97d {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:46 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d696cc84-633d-45a1-aba5-0413026ec56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694d0d64-0714-4a42-902f-39fab75b219e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae55a01e-253a-4298-a377-1671fedfd662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:46 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d 1073741824 Aug 19 00:14:46 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Volume volume-694d0d64-0714-4a42-902f-39fab75b219e (694d0d64-0714-4a42-902f-39fab75b219e): created successfully Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae55a01e-253a-4298-a377-1671fedfd662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Flow 'volume_create_manager' (bf904cc6-0fc7-4ef2-aab1-aa99540bd397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1e6c27e3-d780-4f4a-988b-38f842d56e30 tempest-GroupSnapshotsV319Test-1686522549 None] Created volume successfully. Aug 19 00:14:47 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d 1073741824" returned: 0 in 1.028s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:47 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d Aug 19 00:14:47 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:47 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d" returned: 0 in 0.421s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d031700-98ad-41b0-bc4e-0e5bc00f7003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb89dbf-3bc1-4a37-9817-25822565f97d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6573f181-f51b-4783-bc36-eb70f7348f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Volume volume-ecb89dbf-3bc1-4a37-9817-25822565f97d (ecb89dbf-3bc1-4a37-9817-25822565f97d): created successfully Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6573f181-f51b-4783-bc36-eb70f7348f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (018f7017-2855-4b17-a37f-b774752c4386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-924af8cc-c9ca-4e65-bd31-3003abb6fe78 tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:14:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] GroupSnapshot 5ca56a03-caab-4da3-aec9-f55fb6be7562: creating. Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Group snapshot 5ca56a03-caab-4da3-aec9-f55fb6be7562: creating. {{(pid=94243) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Creating offline snapshot 1cd8dcc9-8033-44c2-8e47-b2f110f73f27 of volume 694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc21207-aa62-43ec-8fd8-fd2a3f790dd0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:48 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e Aug 19 00:14:48 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:48 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e" returned: 0 in 0.447s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:48 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 1G Aug 19 00:14:48 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:49 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 1G" returned: 0 in 0.936s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694d0d64-0714-4a42-902f-39fab75b219e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:49 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694d0d64-0714-4a42-902f-39fab75b219e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 Aug 19 00:14:49 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:50 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694d0d64-0714-4a42-902f-39fab75b219e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27" returned: 0 in 0.742s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:50 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:14:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:50 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 Aug 19 00:14:50 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:50 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=133,cinder:DELETE=13,cinder:SELECT=103,cinder:INSERT=33 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:14:50 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=96,cinder:UPDATE=129,cinder:INSERT=29,cinder:DELETE=10 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:14:50 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:50 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (8dc307c1-9eae-40a5-9e84-11a9559e648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c484f3-21be-465b-a997-5272f473b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27" returned: 0 in 0.457s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c484f3-21be-465b-a997-5272f473b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1828423513',display_name='tempest-VolumesGetTest-Volume-1055804401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270f6564-1161-4aa3-9b7e-1421234be9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:51Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f88384-353f-43c5-8514-e97c19f448de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f88384-353f-43c5-8514-e97c19f448de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63929ad-fce7-4031-858e-71e749d18ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63929ad-fce7-4031-858e-71e749d18ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270f6564-1161-4aa3-9b7e-1421234be9e3', 'volume_name': 'volume-270f6564-1161-4aa3-9b7e-1421234be9e3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481aa2c4-c5bd-4e1f-ba8b-b708eee7d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481aa2c4-c5bd-4e1f-ba8b-b708eee7d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca0ff49-d7cc-4bae-b449-3b3bd29a70ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:51 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Volume 270f6564-1161-4aa3-9b7e-1421234be9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270f6564-1161-4aa3-9b7e-1421234be9e3', 'volume_size': 1} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:51 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info Aug 19 00:14:51 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3ab4ad5f-b59d-4303-afd2-eabca06ce248 tempest-VolumesActionsTest-1267328008 None] Acquiring lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" by "attach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3ab4ad5f-b59d-4303-afd2-eabca06ce248 tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" acquired by "attach_volume" :: waited 0.046s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3ab4ad5f-b59d-4303-afd2-eabca06ce248 tempest-VolumesActionsTest-1267328008 None] Attaching volume f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 to instance bf81c75e-49a2-4ab2-9a85-308d726e71aa at mountpoint /dev/vdb on host None. Aug 19 00:14:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3ab4ad5f-b59d-4303-afd2-eabca06ce248 tempest-VolumesActionsTest-1267328008 None] Attach volume completed successfully. Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3ab4ad5f-b59d-4303-afd2-eabca06ce248 tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" released by "attach_volume" :: held 0.267s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:51 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info" returned: 0 in 0.567s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:51 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:51 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info Aug 19 00:14:51 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b43a8412-e83a-4c49-b506-cb621c461bad tempest-VolumesActionsTest-1267328008 None] Acquiring lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-detach_volume" by "detach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b43a8412-e83a-4c49-b506-cb621c461bad tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b43a8412-e83a-4c49-b506-cb621c461bad tempest-VolumesActionsTest-1267328008 None] Detaching volume f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 from instance bf81c75e-49a2-4ab2-9a85-308d726e71aa. Aug 19 00:14:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b43a8412-e83a-4c49-b506-cb621c461bad tempest-VolumesActionsTest-1267328008 None] Detach volume completed successfully. Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b43a8412-e83a-4c49-b506-cb621c461bad tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:52 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.info" returned: 0 in 0.647s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.059s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1828423513',display_name='tempest-VolumesGetTest-Volume-1055804401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270f6564-1161-4aa3-9b7e-1421234be9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:14:51Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Creating volume 270f6564-1161-4aa3-9b7e-1421234be9e3 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:14:52 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:14:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:52 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 1073741824 Aug 19 00:14:52 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-86fe0908-576c-4e14-82b2-49db06f9399a tempest-GroupSnapshotsV319Test-1686522549 None] group_snapshot 5ca56a03-caab-4da3-aec9-f55fb6be7562: created successfully Aug 19 00:14:53 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 1073741824" returned: 0 in 1.112s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] group_snapshot 5ca56a03-caab-4da3-aec9-f55fb6be7562: deleting Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] group_snapshot 5ca56a03-caab-4da3-aec9-f55fb6be7562: deleting {{(pid=94243) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:53 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 Aug 19 00:14:53 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "cinder-quobyte-694d0d64-0714-4a42-902f-39fab75b219e" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "cinder-quobyte-694d0d64-0714-4a42-902f-39fab75b219e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "cinder-quobyte-1cd8dcc9-8033-44c2-8e47-b2f110f73f27" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "cinder-quobyte-1cd8dcc9-8033-44c2-8e47-b2f110f73f27" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Deleting offline snapshot 1cd8dcc9-8033-44c2-8e47-b2f110f73f27 of volume 694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] snapshot_file for this snap is: volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c354b33-ec5a-462a-8d96-f4c36db31b1a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:54 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 Aug 19 00:14:54 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:54 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3" returned: 0 in 0.566s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca0ff49-d7cc-4bae-b449-3b3bd29a70ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270f6564-1161-4aa3-9b7e-1421234be9e3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53ec67e-55fb-493b-b8bd-905cb2c94485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:54 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Volume volume-270f6564-1161-4aa3-9b7e-1421234be9e3 (270f6564-1161-4aa3-9b7e-1421234be9e3): created successfully Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53ec67e-55fb-493b-b8bd-905cb2c94485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (8dc307c1-9eae-40a5-9e84-11a9559e648b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:54 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-03886345-55ac-48cb-a124-1b38c1741194 tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:14:54 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27" returned: 0 in 0.622s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694d0d64-0714-4a42-902f-39fab75b219e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba00c5f-82c2-4dd5-a820-b221b2171663]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:54 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e Aug 19 00:14:54 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:54 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e" returned: 0 in 0.381s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:55 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 Aug 19 00:14:55 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:55 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27" returned: 0 in 0.560s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:55 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27 Aug 19 00:14:55 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-270f6564-1161-4aa3-9b7e-1421234be9e3-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Lock "cinder-270f6564-1161-4aa3-9b7e-1421234be9e3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-270f6564-1161-4aa3-9b7e-1421234be9e3" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-270f6564-1161-4aa3-9b7e-1421234be9e3" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed63ad00-a6e1-4214-b13b-6e06055f1ebe]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:55 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 Aug 19 00:14:55 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:56 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e.1cd8dcc9-8033-44c2-8e47-b2f110f73f27" returned: 0 in 0.540s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "cinder-quobyte-1cd8dcc9-8033-44c2-8e47-b2f110f73f27" released by "_delete_snapshot" :: held 2.258s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "cinder-quobyte-694d0d64-0714-4a42-902f-39fab75b219e" released by "delete_snapshot" :: held 2.305s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:56 devstack cinder-volume[94243]: WARNING cinder.quota [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-445269745 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-445269745, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:14:56 devstack cinder-volume[94243]: WARNING cinder.quota [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-445269745 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-445269745, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] Created reservations ['daa17c2f-9f67-40a0-aa5b-90f53ac022fb', '1f8b8302-68bc-4b85-8046-105c097a7794', '48603bf2-599f-4d5b-bf4a-ecf8331c1aa2', '2ff42731-a4f9-4544-b44e-5d345ce21c67'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:56 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3" returned: 0 in 0.485s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:56 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3 Aug 19 00:14:56 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:56 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-84120678-8053-45f7-b1d4-89ced88c8150 tempest-GroupSnapshotsV319Test-1686522549 None] group_snapshot 5ca56a03-caab-4da3-aec9-f55fb6be7562: deleted successfully Aug 19 00:14:56 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-270f6564-1161-4aa3-9b7e-1421234be9e3" returned: 0 in 0.294s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-270f6564-1161-4aa3-9b7e-1421234be9e3" released by "delete_volume" :: held 0.859s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Created reservations ['703c3d58-fd5e-4091-b5ff-e3cfb03e82b1', '4ddbb027-1467-48c7-906f-eebd8ae25132', 'b16bea32-0025-46d5-9e93-b04ce82e8a20', '0a8c3f8c-b5b7-4d84-9f80-b2d4fb025c7b'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:56 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:56 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-ecb89dbf-3bc1-4a37-9817-25822565f97d-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Lock "cinder-ecb89dbf-3bc1-4a37-9817-25822565f97d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-ecb89dbf-3bc1-4a37-9817-25822565f97d" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-ecb89dbf-3bc1-4a37-9817-25822565f97d" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd4661-b368-474b-ac15-b2e486406e7b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:57 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-818f431b-9656-4d4f-bca7-fbdd59d6c9e5 tempest-VolumesGetTest-177776702 None] Lock "cinder-270f6564-1161-4aa3-9b7e-1421234be9e3-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:57 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d Aug 19 00:14:57 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:57 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d" returned: 0 in 0.492s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:57 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d Aug 19 00:14:57 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "cinder-quobyte-694d0d64-0714-4a42-902f-39fab75b219e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "cinder-quobyte-694d0d64-0714-4a42-902f-39fab75b219e" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:14:57 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ecb89dbf-3bc1-4a37-9817-25822565f97d" returned: 0 in 0.360s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b3fd17-83e7-4948-a52a-472d457c56bc]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-ecb89dbf-3bc1-4a37-9817-25822565f97d" released by "delete_volume" :: held 0.932s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Created reservations ['cc9f41ae-e5c2-4f49-9765-0086e9a8af58', 'd0907dc8-9ef3-4643-aafa-46f9260ee3c3', '927bc888-69de-44bc-84ff-0d7f24ded8d8', '66690f44-3b82-4a02-afc3-d2e4e315e270'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:58 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e Aug 19 00:14:58 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:58 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:58 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:58 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c614d073-2b44-4b2f-8e6c-843198cfcab3 tempest-VolumesGetTest-177776702 None] Lock "cinder-ecb89dbf-3bc1-4a37-9817-25822565f97d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:58 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e" returned: 0 in 0.592s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:58 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e Aug 19 00:14:58 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:58 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-694d0d64-0714-4a42-902f-39fab75b219e" returned: 0 in 0.288s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "cinder-quobyte-694d0d64-0714-4a42-902f-39fab75b219e" released by "delete_volume" :: held 0.991s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Created reservations ['e6a087c0-6004-46f2-b10a-907d3cbf64e8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:58 devstack cinder-volume[94243]: WARNING cinder.quota [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-445269745 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-445269745, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:14:58 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Created reservations ['1084c126-3d22-4382-ada1-a01683a452d1', '40c6dfc6-a1c8-4d5f-bb9a-4fce2bc4dc5c', '90251eb0-ef21-42d2-a180-3178d71be448', '2b1389ce-ddac-4aa9-9559-2af7d92a58ee'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[905cf7e2-562d-45b8-93eb-f90426cc104f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:59 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:14:59 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:59 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:14:59 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:59 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.338s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:14:59 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:59 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6e8d6e7a-8c25-4950-bea3-ea59aa782a47 tempest-GroupSnapshotsV319Test-1686522549 None] Delete group completed successfully. Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13fdf34-10b6-43da-b773-ec8e1622f30d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:59 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:14:59 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (7f029781-5aac-4e6f-924b-5e2b859e8420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f490ecad-4eea-4926-b03b-bb26ca864c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f490ecad-4eea-4926-b03b-bb26ca864c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1788300542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c21044b-a679-442a-9c6d-b657cd3e9bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:00Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409f2eab-c09e-400b-bba1-f933bff2eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409f2eab-c09e-400b-bba1-f933bff2eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6905608-f711-4a40-9ff2-e0470df01402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6905608-f711-4a40-9ff2-e0470df01402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'volume_name': 'volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb9ebd-4195-4c07-8398-bb7806ed9207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badb9ebd-4195-4c07-8398-bb7806ed9207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c344980-653f-44ea-b7e8-77be96d64b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:14:59 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Volume 0c21044b-a679-442a-9c6d-b657cd3e9bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'volume_size': 1} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:14:59 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.424s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:14:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.3a3c9f05-faf3-46e3-8c6c-74950bf47408uq9u627w.img {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:14:59 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.3a3c9f05-faf3-46e3-8c6c-74950bf47408uq9u627w.img Aug 19 00:14:59 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:04 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.3a3c9f05-faf3-46e3-8c6c-74950bf47408uq9u627w.img" returned: 0 in 4.977s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:04 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feffa11-b14f-475e-b820-2e8aad58fc18]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:05 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:15:05 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:05 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.544s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:05 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.3a3c9f05-faf3-46e3-8c6c-74950bf47408uq9u627w.img {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:15:05 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Converted 1024.00 MB image at 205.69 MB/s Aug 19 00:15:05 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] 3a3c9f05-faf3-46e3-8c6c-74950bf47408 was raw, no need to convert to raw {{(pid=94243) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 19 00:15:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e2bb999d-9676-4891-918d-158850838c1e tempest-GroupsTest-1364871081 None] Group tempest-Group1-1906768726: creating Aug 19 00:15:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e2bb999d-9676-4891-918d-158850838c1e tempest-GroupsTest-1364871081 None] Group tempest-Group1-1906768726: created successfully Aug 19 00:15:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e2bb999d-9676-4891-918d-158850838c1e tempest-GroupsTest-1364871081 None] Create group completed successfully. Aug 19 00:15:09 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5f04ac27-f2d9-432f-9fca-bb20e7a4ffdd tempest-GroupsTest-1364871081 None] Group tempest-Group2-893112625: creating Aug 19 00:15:09 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5f04ac27-f2d9-432f-9fca-bb20e7a4ffdd tempest-GroupsTest-1364871081 None] Group tempest-Group2-893112625: created successfully Aug 19 00:15:09 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5f04ac27-f2d9-432f-9fca-bb20e7a4ffdd tempest-GroupsTest-1364871081 None] Create group completed successfully. Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Flow 'volume_create_manager' (259b57ad-ef5b-42de-8c54-670b13607db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9745f7d-14b8-4e77-bdf6-23d6d072fd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9745f7d-14b8-4e77-bdf6-23d6d072fd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289631921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8632a67-175e-48a7-8e83-f6487fd1f0e4,host='devstack@QuobyteHD#QuobyteHD',id=997baad1-b6cb-41e6-a115-545a74122b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7564a34a71224404903cfe42f7c250c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:11Z,use_quota=True,user_id='56cca87089804c5380c488c8054d5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8555b81-f866-4726-bc42-5df5856dd0f8),volume_type_id=b8555b81-f866-4726-bc42-5df5856dd0f8)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804aaa8b-2b34-4026-b08f-7fbf6fdc3afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804aaa8b-2b34-4026-b08f-7fbf6fdc3afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71829a90-5441-4a29-bc37-bc271d3c187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71829a90-5441-4a29-bc37-bc271d3c187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997baad1-b6cb-41e6-a115-545a74122b03', 'volume_name': 'volume-997baad1-b6cb-41e6-a115-545a74122b03', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a796f56a-fde3-44ee-8ac8-3c328edb957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a796f56a-fde3-44ee-8ac8-3c328edb957c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61605f6-1074-482b-aa4a-df17191fbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Volume 997baad1-b6cb-41e6-a115-545a74122b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997baad1-b6cb-41e6-a115-545a74122b03', 'volume_size': 1} Aug 19 00:15:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Flow 'volume_create_manager' (4f24ea2a-8e41-44fb-9600-e275a55d0369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce7b409-9243-4806-9363-5a01d92afcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce7b409-9243-4806-9363-5a01d92afcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1140443023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb21514d-d060-42ed-a40e-ee27d4ad028f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc70e6cc4c44e45bff0e82c13a3bf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:13Z,use_quota=True,user_id='eb16e0d7550f40fd8d05d0aedf0b1741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dfd566-53a3-4a27-a9cb-9ff8923fc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04dfd566-53a3-4a27-a9cb-9ff8923fc525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a923ba-b3b1-41a6-adb9-d4769bbddb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a923ba-b3b1-41a6-adb9-d4769bbddb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb21514d-d060-42ed-a40e-ee27d4ad028f', 'volume_name': 'volume-eb21514d-d060-42ed-a40e-ee27d4ad028f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71bb897-0c07-4d5a-9918-56dd435d386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71bb897-0c07-4d5a-9918-56dd435d386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7a1ae8-d037-4e30-91bb-3fbb2094a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Volume eb21514d-d060-42ed-a40e-ee27d4ad028f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb21514d-d060-42ed-a40e-ee27d4ad028f', 'volume_size': 1} Aug 19 00:15:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:13 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:13 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:13 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.273s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:15:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:15:22 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=39,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:15:22 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=50,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.585s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Uploaded volume to glance image-id: 3a3c9f05-faf3-46e3-8c6c-74950bf47408. {{(pid=94243) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.765s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1788300542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c21044b-a679-442a-9c6d-b657cd3e9bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:00Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Creating volume 0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:25 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:25 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd 1073741824 Aug 19 00:15:25 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6499b44f-5471-4335-a8e1-32f3d14d409e tempest-VolumesActionsTest-1267328008 None] Copy volume to image completed successfully. Aug 19 00:15:26 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd 1073741824" returned: 0 in 0.411s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:26 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd Aug 19 00:15:26 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:26 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.042s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e8632a67-175e-48a7-8e83-f6487fd1f0e4,created_at=2026-08-18T22:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-289631921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e8632a67-175e-48a7-8e83-f6487fd1f0e4,host='devstack@QuobyteHD#QuobyteHD',id=997baad1-b6cb-41e6-a115-545a74122b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7564a34a71224404903cfe42f7c250c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:11Z,use_quota=True,user_id='56cca87089804c5380c488c8054d5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8555b81-f866-4726-bc42-5df5856dd0f8),volume_type_id=b8555b81-f866-4726-bc42-5df5856dd0f8)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Creating volume 997baad1-b6cb-41e6-a115-545a74122b03 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:26 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c344980-653f-44ea-b7e8-77be96d64b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:26 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 1073741824 Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11498886-1c91-44e2-a571-32d0276dfef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:26 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Volume volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd (0c21044b-a679-442a-9c6d-b657cd3e9bdd): created successfully Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11498886-1c91-44e2-a571-32d0276dfef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (7f029781-5aac-4e6f-924b-5e2b859e8420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-87bffbb0-2cb4-4199-97ae-c4074eb899fa tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:15:26 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 1073741824" returned: 0 in 0.517s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:26 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 Aug 19 00:15:26 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:27 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.340s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1140443023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb21514d-d060-42ed-a40e-ee27d4ad028f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc70e6cc4c44e45bff0e82c13a3bf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:13Z,use_quota=True,user_id='eb16e0d7550f40fd8d05d0aedf0b1741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Creating volume eb21514d-d060-42ed-a40e-ee27d4ad028f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:27 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:27 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f 1073741824 Aug 19 00:15:27 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61605f6-1074-482b-aa4a-df17191fbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997baad1-b6cb-41e6-a115-545a74122b03', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e01295-cfe0-4b68-8298-6495009b8379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Volume volume-997baad1-b6cb-41e6-a115-545a74122b03 (997baad1-b6cb-41e6-a115-545a74122b03): created successfully Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e01295-cfe0-4b68-8298-6495009b8379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Flow 'volume_create_manager' (259b57ad-ef5b-42de-8c54-670b13607db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-77b53f80-b59d-491d-bb40-81bee7e9f135 tempest-GroupsTest-1364871081 None] Created volume successfully. Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (a7fae898-d3a7-40cd-b03c-932dcba6f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea66651-f98f-41fe-8e2c-fb7b945b777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea66651-f98f-41fe-8e2c-fb7b945b777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-665292027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038d7418-6d98-42c2-be2b-58003cfbcc30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0c21044b-a679-442a-9c6d-b657cd3e9bdd,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:27Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13eb51ac-f2b5-460c-b3eb-29f442744ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13eb51ac-f2b5-460c-b3eb-29f442744ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6e31c9-16b7-4d79-9185-daa60a82dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6e31c9-16b7-4d79-9185-daa60a82dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '038d7418-6d98-42c2-be2b-58003cfbcc30', 'volume_name': 'volume-038d7418-6d98-42c2-be2b-58003cfbcc30', 'volume_size': 1, 'source_volid': '0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'source_volstatus': 'available'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09496e-9b98-4a3c-804e-2bac9763e99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d09496e-9b98-4a3c-804e-2bac9763e99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b762ea-09f3-49f1-a6b0-6b6c07ecd3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Volume 038d7418-6d98-42c2-be2b-58003cfbcc30: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-038d7418-6d98-42c2-be2b-58003cfbcc30', 'volume_size': 1, 'source_volid': '0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'source_volstatus': 'available'} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:27 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f 1073741824" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:27 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f Aug 19 00:15:27 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:27 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f" returned: 0 in 0.247s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.819s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7a1ae8-d037-4e30-91bb-3fbb2094a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb21514d-d060-42ed-a40e-ee27d4ad028f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecee23c2-e67a-448a-a69c-9eab27fe1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3c7d6-8889-4d44-8a1f-3f731483ff9c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Volume volume-eb21514d-d060-42ed-a40e-ee27d4ad028f (eb21514d-d060-42ed-a40e-ee27d4ad028f): created successfully Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecee23c2-e67a-448a-a69c-9eab27fe1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Flow 'volume_create_manager' (4f24ea2a-8e41-44fb-9600-e275a55d0369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-871b96a0-304f-489d-8cda-378f65c95cb3 tempest-AttachVolumeNegativeTest-1110771946 None] Created volume successfully. Aug 19 00:15:28 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:15:28 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Acquiring lock "cinder-quobyte-997baad1-b6cb-41e6-a115-545a74122b03" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Lock "cinder-quobyte-997baad1-b6cb-41e6-a115-545a74122b03" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2ad88-446e-4572-aabd-d382f34ca994]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:28 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 Aug 19 00:15:28 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:28 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.381s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[892658af-f518-47e3-99fe-fe9abd23ccce]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:28 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:15:28 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:28 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03" returned: 0 in 0.367s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:28 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03 Aug 19 00:15:28 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:28 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:28 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-997baad1-b6cb-41e6-a115-545a74122b03" returned: 0 in 0.270s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Lock "cinder-quobyte-997baad1-b6cb-41e6-a115-545a74122b03" released by "delete_volume" :: held 0.700s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:28 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img Aug 19 00:15:28 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Created reservations ['04ca71fd-900b-406d-b5db-b2ca34ef182e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:28 devstack cinder-volume[94243]: WARNING cinder.quota [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-90854135 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-90854135, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:15:28 devstack cinder-volume[94243]: WARNING cinder.quota [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-90854135 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-90854135, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:15:28 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Created reservations ['48dc6e13-f34f-44f8-aa41-099c0b0f0b6a', 'e6cc2c6f-c381-4a13-abe3-da05007208f7', 'bca50aab-4f53-4ba6-9de4-77888ae1e3d1', '9ab4faae-be59-415a-ad53-fbb37db5ab4c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:29 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:29 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:29 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.659s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-da4fac6a-a322-45d2-9a6a-7df5a71fb744 tempest-GroupsTest-1364871081 None] Delete group completed successfully. Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Created reservations ['21d5b076-4dbb-4591-b283-26f3faed3dee'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:30 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:30 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-39bda309-2b04-443d-abb1-6614ac9915ae req-4384d2fb-77e6-4049-a1f1-7defc8c8ff4f tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:30 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.622s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:30 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-164f6fbc-a03b-4182-82b2-864d919d5680 tempest-GroupsTest-1364871081 None] Delete group completed successfully. Aug 19 00:15:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cc868edc-7452-4bd8-b3b2-a8bf658383a6 tempest-GroupsTest-1364871081 None] Group tempest-GroupsTest-Group-1027737143: creating Aug 19 00:15:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cc868edc-7452-4bd8-b3b2-a8bf658383a6 tempest-GroupsTest-1364871081 None] Group tempest-GroupsTest-Group-1027737143: created successfully Aug 19 00:15:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cc868edc-7452-4bd8-b3b2-a8bf658383a6 tempest-GroupsTest-1364871081 None] Create group completed successfully. Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Flow 'volume_create_manager' (5ff97344-68f2-4a06-b8a3-8047b3c39f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b534e5-3864-4654-aec2-9885040785e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b534e5-3864-4654-aec2-9885040785e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-506288834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f433138-a8e0-4e27-be86-ee5efb93821e,host='devstack@QuobyteHD#QuobyteHD',id=f0043abf-070b-41d7-b830-a245e2d9dc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7564a34a71224404903cfe42f7c250c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:33Z,use_quota=True,user_id='56cca87089804c5380c488c8054d5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977c9fd3-3474-40ef-8d74-b3aaf2ead63f),volume_type_id=977c9fd3-3474-40ef-8d74-b3aaf2ead63f)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7cefea-83ce-4114-9742-8dc3544b277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7cefea-83ce-4114-9742-8dc3544b277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:33 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7167f330-b5bb-43a3-99b2-8a5e99a60320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7167f330-b5bb-43a3-99b2-8a5e99a60320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0043abf-070b-41d7-b830-a245e2d9dc35', 'volume_name': 'volume-f0043abf-070b-41d7-b830-a245e2d9dc35', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0f9fe1-2f36-4331-a2fc-dfaa0e5affdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0f9fe1-2f36-4331-a2fc-dfaa0e5affdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5fe59a-4a19-4980-b3d2-5c0680ab86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:33 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Volume f0043abf-070b-41d7-b830-a245e2d9dc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0043abf-070b-41d7-b830-a245e2d9dc35', 'volume_size': 1} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img" returned: 0 in 4.916s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9503b25-5717-4530-afad-9331f3402c67]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:33 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:15:33 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:34 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.548s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:15:34 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Converted 1024.00 MB image at 208.25 MB/s Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] 7b40e56a-eea3-43a5-9945-e4287b4c71a1 was raw, converting to qcow2 {{(pid=94243) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[31263404-10ea-4e7c-a74a-24448c017ed8]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:34 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img Aug 19 00:15:34 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:34 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img" returned: 0 in 0.322s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:34 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img Aug 19 00:15:34 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:34 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img" returned: 1 in 0.323s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:15:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:34 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3 Aug 19 00:15:34 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:35 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:35 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Image conversion details: src /opt/stack/data/cinder/conversion/f8bbb658-ee5a-4b0c-9681-2aa741db5fd5.temp_image.7b40e56a-eea3-43a5-9945-e4287b4c71a1ql4mp2vl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:15:35 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 19 00:15:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e974f7bc-5dbd-4b03-9245-42bccef43adb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:35 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3 Aug 19 00:15:35 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:35 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kpuqa4a3" returned: 0 in 0.318s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.823s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Uploaded volume to glance image-id: 7b40e56a-eea3-43a5-9945-e4287b4c71a1. {{(pid=94243) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 19 00:15:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.339s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:36 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Cloning volume 0c21044b-a679-442a-9c6d-b657cd3e9bdd to volume 038d7418-6d98-42c2-be2b-58003cfbcc30 Aug 19 00:15:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a99ee794-0e48-4f2b-9d45-6a0a2e4e549e tempest-VolumesActionsTest-1267328008 None] Copy volume to image completed successfully. Aug 19 00:15:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Creating offline snapshot 19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 of volume 0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:15:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9090c171-5f85-4164-a9d3-d08db04bb8cb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:36 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd Aug 19 00:15:36 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:37 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:37 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 1G Aug 19 00:15:37 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:37 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 1G" returned: 0 in 0.396s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:37 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 Aug 19 00:15:37 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:37 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:37 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 is being set with open permissions: ugo+rw Aug 19 00:15:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:37 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 Aug 19 00:15:37 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:38 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" returned: 0 in 0.263s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:38 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info Aug 19 00:15:38 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Acquiring lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:38 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info" returned: 0 in 0.285s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:38 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info is being set with open permissions: ugo+rw Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Acquiring lock "cinder-quobyte-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:38 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info Aug 19 00:15:38 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Lock "cinder-quobyte-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[be697405-2356-4e20-a56a-8e2ffdf768b1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:38 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:15:38 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:38 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.info" returned: 0 in 0.264s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-038d7418-6d98-42c2-be2b-58003cfbcc30" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-038d7418-6d98-42c2-be2b-58003cfbcc30" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] snapshot: 19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8, volume: 038d7418-6d98-42c2-be2b-58003cfbcc30, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc7720-1c09-4e6b-a416-576bc1bd8d6f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:38 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.360s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:38 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5 Aug 19 00:15:38 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:38 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 Aug 19 00:15:38 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:39 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" returned: 0 in 0.251s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Lock "cinder-quobyte-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5" released by "delete_volume" :: held 0.649s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:39 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50df3a3-aaf9-4008-a543-758c4898c054]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Created reservations ['4fe6324a-b97f-456c-8a5e-a5357ef03136', 'e3c80e3c-4ec1-4595-9689-0b9d1703212c', 'd260c0a4-5c2b-4f70-841f-0665e13029d5', 'afc15be9-b382-452a-a517-461582737ae6'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:39 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd Aug 19 00:15:39 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:39 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:39 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:39 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:39 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.317s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Deleted volume successfully. Aug 19 00:15:39 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 Aug 19 00:15:39 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c190271-0c6e-41e2-890b-8b70d671fd2b tempest-VolumesActionsTest-1267328008 None] Lock "cinder-f8bbb658-ee5a-4b0c-9681-2aa741db5fd5-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:44 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30" returned: 0 in 5.143s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:44 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:15:44 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Converted 1024.00 MB image at 199.07 MB/s Aug 19 00:15:44 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 is being set with open permissions: ugo+rw Aug 19 00:15:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:44 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 Aug 19 00:15:44 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:45 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-038d7418-6d98-42c2-be2b-58003cfbcc30" released by "_copy_volume_from_snapshot" :: held 6.257s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Deleting offline snapshot 19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 of volume 0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] snapshot_file for this snap is: volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a529d-5ee2-403c-a298-eb0b0b1ec87a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:45 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 Aug 19 00:15:45 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:45 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" returned: 0 in 0.404s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca947a45-beba-40c2-9c03-13bb53309219]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:45 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd Aug 19 00:15:45 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:46 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd" returned: 0 in 0.641s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:46 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 Aug 19 00:15:46 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:46 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" returned: 0 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:46 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8 Aug 19 00:15:46 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:46 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd.19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" returned: 0 in 0.275s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-19c2d2b2-f7a2-4e8b-ba03-4a0c47338ee8" released by "_delete_snapshot" :: held 1.768s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.113s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-39bda309-2b04-443d-abb1-6614ac9915ae req-4384d2fb-77e6-4049-a1f1-7defc8c8ff4f tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.508s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-39bda309-2b04-443d-abb1-6614ac9915ae req-4384d2fb-77e6-4049-a1f1-7defc8c8ff4f tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.197s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f433138-a8e0-4e27-be86-ee5efb93821e,created_at=2026-08-18T22:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-506288834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f433138-a8e0-4e27-be86-ee5efb93821e,host='devstack@QuobyteHD#QuobyteHD',id=f0043abf-070b-41d7-b830-a245e2d9dc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7564a34a71224404903cfe42f7c250c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:33Z,use_quota=True,user_id='56cca87089804c5380c488c8054d5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977c9fd3-3474-40ef-8d74-b3aaf2ead63f),volume_type_id=977c9fd3-3474-40ef-8d74-b3aaf2ead63f)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Creating volume f0043abf-070b-41d7-b830-a245e2d9dc35 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:46 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b762ea-09f3-49f1-a6b0-6b6c07ecd3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038d7418-6d98-42c2-be2b-58003cfbcc30', 'volume_size': 1, 'source_volid': '0c21044b-a679-442a-9c6d-b657cd3e9bdd', 'source_volstatus': 'available'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71115233-7b33-4133-ae1c-6563526a03e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:46 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 1073741824 Aug 19 00:15:46 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Volume volume-038d7418-6d98-42c2-be2b-58003cfbcc30 (038d7418-6d98-42c2-be2b-58003cfbcc30): created successfully Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71115233-7b33-4133-ae1c-6563526a03e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (a7fae898-d3a7-40cd-b03c-932dcba6f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-39bda309-2b04-443d-abb1-6614ac9915ae req-4384d2fb-77e6-4049-a1f1-7defc8c8ff4f tempest-AttachVolumeNegativeTest-1110771946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-eb21514d-d060-42ed-a40e-ee27d4ad028f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac9e49e3-3697-40c6-b8f0-66047a949299', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:15:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f22b24f6-a79b-44a4-ac95-5bc90c3cf9cd tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:15:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-39bda309-2b04-443d-abb1-6614ac9915ae req-4384d2fb-77e6-4049-a1f1-7defc8c8ff4f tempest-AttachVolumeNegativeTest-1110771946 None] attachment_update completed successfully. Aug 19 00:15:47 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 1073741824" returned: 0 in 0.621s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:47 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 Aug 19 00:15:47 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:47 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35" returned: 0 in 0.318s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5fe59a-4a19-4980-b3d2-5c0680ab86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0043abf-070b-41d7-b830-a245e2d9dc35', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0380cd07-69de-456d-b198-cf918abd8747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Volume volume-f0043abf-070b-41d7-b830-a245e2d9dc35 (f0043abf-070b-41d7-b830-a245e2d9dc35): created successfully Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0380cd07-69de-456d-b198-cf918abd8747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Flow 'volume_create_manager' (5ff97344-68f2-4a06-b8a3-8047b3c39f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-346ff1cd-e6be-4672-9bfa-19d208303ceb tempest-GroupsTest-1364871081 None] Created volume successfully. Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (9ba3e6e6-a6a4-4e04-bd79-3565d30ade89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0345fc-caad-4f75-a92a-e6374481a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0345fc-caad-4f75-a92a-e6374481a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1375617300',display_name='tempest-VolumesGetTest-Volume-1593395434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4914e9f-bf25-4794-9937-f74549afe93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:48Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d97dc6a-9bce-4982-adfd-e352e4d4a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d97dc6a-9bce-4982-adfd-e352e4d4a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660b8071-e99b-418f-a236-967eadbb914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660b8071-e99b-418f-a236-967eadbb914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4914e9f-bf25-4794-9937-f74549afe93f', 'volume_name': 'volume-e4914e9f-bf25-4794-9937-f74549afe93f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbb186d-9ad0-405b-81cf-6d433eb0bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbb186d-9ad0-405b-81cf-6d433eb0bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a75980c-611a-40c8-85e3-ae3f4e252ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Volume e4914e9f-bf25-4794-9937-f74549afe93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4914e9f-bf25-4794-9937-f74549afe93f', 'volume_size': 1} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1375617300',display_name='tempest-VolumesGetTest-Volume-1593395434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4914e9f-bf25-4794-9937-f74549afe93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:48Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Creating volume e4914e9f-bf25-4794-9937-f74549afe93f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:48 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:48 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f 1073741824 Aug 19 00:15:48 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:48 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f 1073741824" returned: 0 in 0.543s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:49 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f Aug 19 00:15:49 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Flow 'volume_create_manager' (55086c96-4360-484e-b818-c9ed724a6381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71dcb6d-b442-44b8-a907-60f751d6e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71dcb6d-b442-44b8-a907-60f751d6e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579844650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f433138-a8e0-4e27-be86-ee5efb93821e,host='devstack@QuobyteHD#QuobyteHD',id=f30480ee-99aa-44e6-b812-9a65c1f576ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7564a34a71224404903cfe42f7c250c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:49Z,use_quota=True,user_id='56cca87089804c5380c488c8054d5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977c9fd3-3474-40ef-8d74-b3aaf2ead63f),volume_type_id=977c9fd3-3474-40ef-8d74-b3aaf2ead63f)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd280d-1522-45df-ae23-67ac23502662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd280d-1522-45df-ae23-67ac23502662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14edad81-e12b-441a-9bb6-ac30084d8166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14edad81-e12b-441a-9bb6-ac30084d8166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30480ee-99aa-44e6-b812-9a65c1f576ea', 'volume_name': 'volume-f30480ee-99aa-44e6-b812-9a65c1f576ea', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603cf886-71b1-469b-8d2f-f7a2b67c179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603cf886-71b1-469b-8d2f-f7a2b67c179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3db35c-092b-4498-8a81-7eed9439eb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Volume f30480ee-99aa-44e6-b812-9a65c1f576ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30480ee-99aa-44e6-b812-9a65c1f576ea', 'volume_size': 1} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:49 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f433138-a8e0-4e27-be86-ee5efb93821e,created_at=2026-08-18T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579844650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f433138-a8e0-4e27-be86-ee5efb93821e,host='devstack@QuobyteHD#QuobyteHD',id=f30480ee-99aa-44e6-b812-9a65c1f576ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7564a34a71224404903cfe42f7c250c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:49Z,use_quota=True,user_id='56cca87089804c5380c488c8054d5a99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977c9fd3-3474-40ef-8d74-b3aaf2ead63f),volume_type_id=977c9fd3-3474-40ef-8d74-b3aaf2ead63f)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Creating volume f30480ee-99aa-44e6-b812-9a65c1f576ea {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:49 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:49 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea 1073741824 Aug 19 00:15:49 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Flow 'volume_create_manager' (c529e331-7089-4218-8ded-d722d85c4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1a1d8a-4c09-40a1-90ad-e0df8c71f0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a75980c-611a-40c8-85e3-ae3f4e252ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4914e9f-bf25-4794-9937-f74549afe93f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd7aaf0-631d-4829-873a-ac666ba38a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Volume volume-e4914e9f-bf25-4794-9937-f74549afe93f (e4914e9f-bf25-4794-9937-f74549afe93f): created successfully Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd7aaf0-631d-4829-873a-ac666ba38a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (9ba3e6e6-a6a4-4e04-bd79-3565d30ade89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1a1d8a-4c09-40a1-90ad-e0df8c71f0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-490321996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a89d222-9450-4bc0-8654-71f12181fcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a118886713244444a468e43730524103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:49Z,use_quota=True,user_id='a8f8c3b74e1b434b860227d8cfbfe416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9617292d-318c-4205-828d-b3a502469d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9617292d-318c-4205-828d-b3a502469d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f2d3a3-2310-49c5-87e7-931991e0ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f2d3a3-2310-49c5-87e7-931991e0ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a89d222-9450-4bc0-8654-71f12181fcbc', 'volume_name': 'volume-7a89d222-9450-4bc0-8654-71f12181fcbc', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5353eec1-7621-49cf-95ef-e0e127fbca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5353eec1-7621-49cf-95ef-e0e127fbca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2b1d82-9c09-4926-a018-3b43692e2c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Volume 7a89d222-9450-4bc0-8654-71f12181fcbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a89d222-9450-4bc0-8654-71f12181fcbc', 'volume_size': 1} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f7773a70-6d48-4f55-8c58-90d2d5d0d363 tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:15:49 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea 1073741824" returned: 0 in 0.505s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:49 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea Aug 19 00:15:49 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:50 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea" returned: 0 in 0.283s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-490321996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a89d222-9450-4bc0-8654-71f12181fcbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a118886713244444a468e43730524103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:49Z,use_quota=True,user_id='a8f8c3b74e1b434b860227d8cfbfe416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Creating volume 7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:15:50 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3db35c-092b-4498-8a81-7eed9439eb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30480ee-99aa-44e6-b812-9a65c1f576ea', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:50 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc 1073741824 Aug 19 00:15:50 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e47657-2f10-4f56-9d4e-00b47a4c3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-bf770642-0550-43f7-b132-94d81db5015c req-8d4b5042-9fff-44de-8f22-cbc9eb5700e7 tempest-AttachVolumeNegativeTest-1110771946 None] Terminate volume connection completed successfully. Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-bf770642-0550-43f7-b132-94d81db5015c req-8d4b5042-9fff-44de-8f22-cbc9eb5700e7 tempest-AttachVolumeNegativeTest-1110771946 None] Deleting attachment ac9e49e3-3697-40c6-b8f0-66047a949299. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:15:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Volume volume-f30480ee-99aa-44e6-b812-9a65c1f576ea (f30480ee-99aa-44e6-b812-9a65c1f576ea): created successfully Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e47657-2f10-4f56-9d4e-00b47a4c3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Flow 'volume_create_manager' (55086c96-4360-484e-b818-c9ed724a6381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e264e515-9466-49c0-9dc5-d940bca2c2fd tempest-GroupsTest-1364871081 None] Created volume successfully. Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-e4914e9f-bf25-4794-9937-f74549afe93f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Lock "cinder-e4914e9f-bf25-4794-9937-f74549afe93f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-e4914e9f-bf25-4794-9937-f74549afe93f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-e4914e9f-bf25-4794-9937-f74549afe93f" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:50 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc 1073741824" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98417f-2a3f-424d-a123-fc9d022d52c7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:50 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc Aug 19 00:15:50 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:50 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f Aug 19 00:15:50 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:51 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc" returned: 0 in 0.288s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2b1d82-9c09-4926-a018-3b43692e2c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a89d222-9450-4bc0-8654-71f12181fcbc', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc41681-6a91-41fc-ba9b-cd22a73060e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:51 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Volume volume-7a89d222-9450-4bc0-8654-71f12181fcbc (7a89d222-9450-4bc0-8654-71f12181fcbc): created successfully Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc41681-6a91-41fc-ba9b-cd22a73060e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Flow 'volume_create_manager' (c529e331-7089-4218-8ded-d722d85c4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-512721d1-1223-438c-ae83-e7a0e7682002 tempest-VolumesCloneTest-1610899518 None] Created volume successfully. Aug 19 00:15:51 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:51 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f Aug 19 00:15:51 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:51 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e4914e9f-bf25-4794-9937-f74549afe93f" returned: 0 in 0.340s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-e4914e9f-bf25-4794-9937-f74549afe93f" released by "delete_volume" :: held 0.882s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Created reservations ['d850b60f-8c39-45b1-bdfa-40ec5c852aeb', 'e069668e-658d-4200-9c32-f9931b1fa5c0', '08ae531f-a5d7-488b-a800-ee4efa805e97', 'a8f034fc-ced8-44c2-a0e5-97d7474b32b8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-781ea311-1b46-4cde-a154-3d61bd4ddf24 tempest-GroupsTest-1364871081 None] Update group completed successfully. Aug 19 00:15:52 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:52 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-038d7418-6d98-42c2-be2b-58003cfbcc30-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Lock "cinder-038d7418-6d98-42c2-be2b-58003cfbcc30-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-038d7418-6d98-42c2-be2b-58003cfbcc30" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Flow 'volume_create_manager' (4064437e-46d7-48cb-8499-1f4b0136c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3b43c2-2d78-4c98-b2f1-79adc3199ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-038d7418-6d98-42c2-be2b-58003cfbcc30" acquired by "delete_volume" :: waited 0.065s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3b43c2-2d78-4c98-b2f1-79adc3199ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-167227394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d896ec-9081-47f7-8a94-d138923259b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a118886713244444a468e43730524103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7a89d222-9450-4bc0-8654-71f12181fcbc,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:52Z,use_quota=True,user_id='a8f8c3b74e1b434b860227d8cfbfe416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be34c388-0e59-4bb8-ba78-866723e49b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be34c388-0e59-4bb8-ba78-866723e49b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68629d75-2d68-48e8-a67d-8caa07b618cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4e51f0-6708-4eb1-a342-3c73dba2f271]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:52 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.352s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68629d75-2d68-48e8-a67d-8caa07b618cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c6d896ec-9081-47f7-8a94-d138923259b7', 'volume_name': 'volume-c6d896ec-9081-47f7-8a94-d138923259b7', 'volume_size': 2, 'source_volid': '7a89d222-9450-4bc0-8654-71f12181fcbc', 'source_volstatus': 'available'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78efada8-03e9-4f51-aac5-201d08c0dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78efada8-03e9-4f51-aac5-201d08c0dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39706288-6e52-49e5-a07c-e36739965625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:52 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Volume c6d896ec-9081-47f7-8a94-d138923259b7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c6d896ec-9081-47f7-8a94-d138923259b7', 'volume_size': 2, 'source_volid': '7a89d222-9450-4bc0-8654-71f12181fcbc', 'source_volstatus': 'available'} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:52 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Cloning volume 7a89d222-9450-4bc0-8654-71f12181fcbc to volume c6d896ec-9081-47f7-8a94-d138923259b7 Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26196cd3-20e0-44ed-a826-a7e4af6c052a tempest-VolumesGetTest-177776702 None] Lock "cinder-e4914e9f-bf25-4794-9937-f74549afe93f-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Creating offline snapshot 5db922cf-7696-4663-8ed0-23c0a7ad16ea of volume 7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8260ba4-2033-4da2-9ee8-957fc87e1d66]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:52 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 Aug 19 00:15:52 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:52 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc Aug 19 00:15:52 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:52 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30" returned: 0 in 0.536s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:52 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30 Aug 19 00:15:52 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:52 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc" returned: 0 in 0.474s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:53 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea 1G Aug 19 00:15:53 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:53 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-038d7418-6d98-42c2-be2b-58003cfbcc30" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-038d7418-6d98-42c2-be2b-58003cfbcc30" released by "delete_volume" :: held 1.025s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-45828bdd-d5f2-47c1-be84-6d903e812ddd tempest-GroupsTest-1364871081 None] Update group completed successfully. Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Created reservations ['85db272c-50a0-410a-896b-2d24e27aa005', 'cfe739de-04fa-44e7-93a7-abc21cb277e7', 'bb6bd456-7cff-4e69-97d1-9c9b89288792', '635e0563-bf4f-4363-9fa5-59a125eb0ed9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:53 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:53 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:53 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea 1G" returned: 0 in 0.635s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a89d222-9450-4bc0-8654-71f12181fcbc -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:53 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a89d222-9450-4bc0-8654-71f12181fcbc -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea Aug 19 00:15:53 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:53 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.276s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a8aab3dd-ec86-4a07-9c15-c754f80d3e04 tempest-VolumesGetTest-177776702 None] Lock "cinder-038d7418-6d98-42c2-be2b-58003cfbcc30-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:53 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a89d222-9450-4bc0-8654-71f12181fcbc -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:53 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea is being set with open permissions: ugo+rw Aug 19 00:15:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:53 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea Aug 19 00:15:53 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:54 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:54 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info Aug 19 00:15:54 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:54 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:54 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info is being set with open permissions: ugo+rw Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-0c21044b-a679-442a-9c6d-b657cd3e9bdd-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:54 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info Aug 19 00:15:54 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Lock "cinder-0c21044b-a679-442a-9c6d-b657cd3e9bdd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-0c21044b-a679-442a-9c6d-b657cd3e9bdd" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-0c21044b-a679-442a-9c6d-b657cd3e9bdd" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf8730c-233b-46d0-a4e3-644acdc065a0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:54 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd Aug 19 00:15:54 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:54 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.info" returned: 0 in 0.283s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "cinder-quobyte-c6d896ec-9081-47f7-8a94-d138923259b7" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-c6d896ec-9081-47f7-8a94-d138923259b7" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] snapshot: 5db922cf-7696-4663-8ed0-23c0a7ad16ea, volume: c6d896ec-9081-47f7-8a94-d138923259b7, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3f4b9-9220-4f5f-a00d-4cfc6e387062]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:54 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea Aug 19 00:15:54 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Acquiring lock "cinder-quobyte-f0043abf-070b-41d7-b830-a245e2d9dc35" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Lock "cinder-quobyte-f0043abf-070b-41d7-b830-a245e2d9dc35" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:55 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd" returned: 0 in 0.469s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[770de97e-f3d8-4cc0-94bf-5a24cea85817]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:55 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd Aug 19 00:15:55 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 Aug 19 00:15:55 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea" returned: 0 in 0.474s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a89d222-9450-4bc0-8654-71f12181fcbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea508d8-96e8-4e10-b3e2-4dba94792c8c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:55 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc Aug 19 00:15:55 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:55 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0c21044b-a679-442a-9c6d-b657cd3e9bdd" returned: 0 in 0.372s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-0c21044b-a679-442a-9c6d-b657cd3e9bdd" released by "delete_volume" :: held 0.910s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Created reservations ['e942c0d9-24b0-4c7e-97f9-34de4c8fe665', '66851cbf-cb61-462c-83cd-ee5b6072e3b2', '6d3bd22b-565e-455a-855d-5cc112a559dd', 'ea2c2180-65be-4b01-9a04-f62643a6147f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:55 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35" returned: 0 in 0.550s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:55 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:55 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35 Aug 19 00:15:55 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc" returned: 0 in 0.467s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:55 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 Aug 19 00:15:55 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:55 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.309s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:55 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-456d92e9-4347-471a-8fc7-9420c28db400 tempest-VolumesGetTest-177776702 None] Lock "cinder-0c21044b-a679-442a-9c6d-b657cd3e9bdd-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:56 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f0043abf-070b-41d7-b830-a245e2d9dc35" returned: 0 in 0.343s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Lock "cinder-quobyte-f0043abf-070b-41d7-b830-a245e2d9dc35" released by "delete_volume" :: held 0.958s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Acquiring lock "cinder-quobyte-f30480ee-99aa-44e6-b812-9a65c1f576ea" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Lock "cinder-quobyte-f30480ee-99aa-44e6-b812-9a65c1f576ea" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a5dba-f70b-429c-9585-80c3f746c01a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:56 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea Aug 19 00:15:56 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:56 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea" returned: 0 in 0.520s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:56 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea Aug 19 00:15:56 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:57 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f30480ee-99aa-44e6-b812-9a65c1f576ea" returned: 0 in 1.023s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Lock "cinder-quobyte-f30480ee-99aa-44e6-b812-9a65c1f576ea" released by "delete_volume" :: held 1.616s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:15:57 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Created reservations ['e9f767d2-e06b-4b98-8f96-0f75122f921a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:58 devstack cinder-volume[94243]: WARNING cinder.quota [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1071531680 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1071531680, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:15:58 devstack cinder-volume[94243]: WARNING cinder.quota [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1071531680 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1071531680, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:15:58 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Created reservations ['c1b51d1a-457d-4ec3-b7e8-a26d045bb039', '6c3dd9ed-2ffc-49ff-9d10-ec9ceb8cce27', '79303b63-5210-4129-bd4b-807f0f3a30ed', 'd775c4e2-e9c8-4f5f-a7df-343704ebfaf1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:58 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Created reservations ['a72c8f51-565c-4e61-85d6-b5412bfec889', '52433140-b71d-43b5-a37f-e1ef86efe40b', 'a6d2eeb9-cdb9-4fb2-9bb6-a2ea7c52352d', 'f67bd9b1-d506-496b-b071-2f51b167bdd8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:15:59 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:15:59 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (86c655bb-5e40-4ac4-9448-da041456c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca84d3cd-6f5a-4e47-ac25-7391729fb205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca84d3cd-6f5a-4e47-ac25-7391729fb205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-793948254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ad4e10-a060-40c1-abdd-6da74f2cf392,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:59Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f900da-04d4-4058-97a2-167a382bc2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f900da-04d4-4058-97a2-167a382bc2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db21c965-c468-4b6d-a33c-b17aa54365a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:15:59 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.713s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:15:59 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:15:59 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c49c89f9-0052-412b-8a2a-e7c940c8d41a tempest-GroupsTest-1364871081 None] Delete group completed successfully. Aug 19 00:16:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db21c965-c468-4b6d-a33c-b17aa54365a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0ad4e10-a060-40c1-abdd-6da74f2cf392', 'volume_name': 'volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0947c08-5232-460c-a55d-0cb6cc546202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0947c08-5232-460c-a55d-0cb6cc546202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d2b5cb-b5de-434c-9771-a7ebc7ecc9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:01 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Volume a0ad4e10-a060-40c1-abdd-6da74f2cf392: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Trying to clone a0ad4e10-a060-40c1-abdd-6da74f2cf392 from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:16:01 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Image download 20.69 MB at 20.69 MB/s Aug 19 00:16:01 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7" returned: 0 in 6.053s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:16:01 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Converted 1024.00 MB image at 169.14 MB/s Aug 19 00:16:01 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 is being set with open permissions: ugo+rw Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8193f4-24fc-471f-90cd-70aa0856a007]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:01 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 Aug 19 00:16:01 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:02 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD Aug 19 00:16:02 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:02 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7" returned: 0 in 0.326s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-c6d896ec-9081-47f7-8a94-d138923259b7" released by "_copy_volume_from_snapshot" :: held 7.411s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "cinder-quobyte-5db922cf-7696-4663-8ed0-23c0a7ad16ea" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-5db922cf-7696-4663-8ed0-23c0a7ad16ea" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Deleting offline snapshot 5db922cf-7696-4663-8ed0-23c0a7ad16ea of volume 7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:16:02 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] snapshot_file for this snap is: volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 is fetched for user 666bfe710be74d47b8576cfea77eb711. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe30f12-8702-4698-b268-216e580f3f67]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f5afc-a7d4-4a3c-a12f-431b5a5de602]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:02 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea Aug 19 00:16:02 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:02 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD Aug 19 00:16:02 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:02 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea" returned: 0 in 0.403s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a89d222-9450-4bc0-8654-71f12181fcbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2ea9a-585b-4042-8612-9a9bedcbabdf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:02 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:02 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc Aug 19 00:16:02 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:03 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc" returned: 0 in 0.634s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:03 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea Aug 19 00:16:03 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:03 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea" returned: 0 in 0.515s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:03 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea Aug 19 00:16:03 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:04 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc.5db922cf-7696-4663-8ed0-23c0a7ad16ea" returned: 0 in 0.307s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-5db922cf-7696-4663-8ed0-23c0a7ad16ea" released by "_delete_snapshot" :: held 2.012s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.906s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-793948254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ad4e10-a060-40c1-abdd-6da74f2cf392,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:15:59Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Creating volume a0ad4e10-a060-40c1-abdd-6da74f2cf392 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:04 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:04 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 1073741824 Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39706288-6e52-49e5-a07c-e36739965625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d896ec-9081-47f7-8a94-d138923259b7', 'volume_size': 2, 'source_volid': '7a89d222-9450-4bc0-8654-71f12181fcbc', 'source_volstatus': 'available'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:04 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6ebcf4-0ee5-4eab-87dc-8225b0292b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:04 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Volume volume-c6d896ec-9081-47f7-8a94-d138923259b7 (c6d896ec-9081-47f7-8a94-d138923259b7): created successfully Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6ebcf4-0ee5-4eab-87dc-8225b0292b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Flow 'volume_create_manager' (4064437e-46d7-48cb-8499-1f4b0136c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-26970baf-fe69-47cd-9933-9b60cd6f7323 tempest-VolumesCloneTest-1610899518 None] Created volume successfully. Aug 19 00:16:04 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 1073741824" returned: 0 in 0.624s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:05 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 Aug 19 00:16:05 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:05 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392" returned: 0 in 0.338s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Attempting download of 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume a0ad4e10-a060-40c1-abdd-6da74f2cf392. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef404e1-d1df-47f8-a9d8-380cfe39b3d6]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:05 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d Aug 19 00:16:05 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "cinder-c6d896ec-9081-47f7-8a94-d138923259b7-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:05 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-c6d896ec-9081-47f7-8a94-d138923259b7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "cinder-quobyte-c6d896ec-9081-47f7-8a94-d138923259b7" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-c6d896ec-9081-47f7-8a94-d138923259b7" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec9a59-352a-4510-b8b2-b752cbcbcecd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:06 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d" returned: 0 in 0.592s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:06 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 Aug 19 00:16:06 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:06 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d Aug 19 00:16:06 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:06 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d" returned: 1 in 0.415s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ktgf_s3d' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[02feaa24-6b7a-4dcc-adef-3a0932294f09]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:06 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7" returned: 0 in 0.486s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:06 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7 Aug 19 00:16:06 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:06 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD Aug 19 00:16:06 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:06 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c6d896ec-9081-47f7-8a94-d138923259b7" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:06 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-c6d896ec-9081-47f7-8a94-d138923259b7" released by "delete_volume" :: held 0.922s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:07 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] 71a9806a-90d3-4b78-b2e4-4f74e1036e43 was qcow2, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Created reservations ['8f8202ba-541d-4eb4-b0f9-628b244c63e8', '576a63d8-4e13-4053-abd7-fa1aa0796c29', '2ba65c68-e714-4517-802d-aeef34834cb5', '88fb0a19-0efe-4bec-ae6e-e02625c16942'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:07 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 Aug 19 00:16:07 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:07 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:07 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:07 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.326s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Deleted volume successfully. Aug 19 00:16:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c660706a-c43c-4d42-a834-648d205a36b2 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-c6d896ec-9081-47f7-8a94-d138923259b7-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b711b0da-d2b2-4f9d-a49e-9dea3ca5903b tempest-GroupsV314Test-1587252300 None] Group tempest-GroupsV314Test-Group-898262451: creating Aug 19 00:16:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b711b0da-d2b2-4f9d-a49e-9dea3ca5903b tempest-GroupsV314Test-1587252300 None] Group tempest-GroupsV314Test-Group-898262451: created successfully Aug 19 00:16:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b711b0da-d2b2-4f9d-a49e-9dea3ca5903b tempest-GroupsV314Test-1587252300 None] Create group completed successfully. Aug 19 00:16:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "cinder-7a89d222-9450-4bc0-8654-71f12181fcbc-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-7a89d222-9450-4bc0-8654-71f12181fcbc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "cinder-quobyte-7a89d222-9450-4bc0-8654-71f12181fcbc" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-7a89d222-9450-4bc0-8654-71f12181fcbc" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:08 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987b1c1-dabb-49cb-9ab1-90c65ed50c45]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:08 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc Aug 19 00:16:08 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:09 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc" returned: 0 in 0.862s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:09 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc Aug 19 00:16:09 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:09 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a89d222-9450-4bc0-8654-71f12181fcbc" returned: 0 in 0.359s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-quobyte-7a89d222-9450-4bc0-8654-71f12181fcbc" released by "delete_volume" :: held 1.353s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:09 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Flow 'volume_create_manager' (ceb055da-a31d-4a1e-b8c2-a47da67a0e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c819d798-ae0f-40fa-ae0e-234bda35f864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392" returned: 0 in 2.833s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_fnzjsdcsdevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:16:09 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Converted 112.00 MB image at 39.51 MB/s Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:09 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 1G Aug 19 00:16:09 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c819d798-ae0f-40fa-ae0e-234bda35f864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8048220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97de65cc-3f86-455b-97d0-e59b88defc65,host='devstack@QuobyteHD#QuobyteHD',id=e598cd2e-742f-4db5-a496-3f7b5f7423e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289dec15526e43c599e8e4839ca8d7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:10Z,use_quota=True,user_id='c7958fea3a6c429a9526c97871b182a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b059f82-76e8-470f-97d1-3edaeb147bc0),volume_type_id=9b059f82-76e8-470f-97d1-3edaeb147bc0)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06690c6-1c69-4a65-80c3-dafa9f847673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06690c6-1c69-4a65-80c3-dafa9f847673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2923047b-dea9-43b0-962c-84c5e9059e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2923047b-dea9-43b0-962c-84c5e9059e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e598cd2e-742f-4db5-a496-3f7b5f7423e6', 'volume_name': 'volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5938d5e5-9dbf-477a-aa00-2bca6d8258f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5938d5e5-9dbf-477a-aa00-2bca6d8258f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4076b4-4765-4dca-b2bc-c9be56a0bb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:09 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Volume e598cd2e-742f-4db5-a496-3f7b5f7423e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6', 'volume_size': 1} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97de65cc-3f86-455b-97d0-e59b88defc65,created_at=2026-08-18T22:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8048220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97de65cc-3f86-455b-97d0-e59b88defc65,host='devstack@QuobyteHD#QuobyteHD',id=e598cd2e-742f-4db5-a496-3f7b5f7423e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289dec15526e43c599e8e4839ca8d7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:10Z,use_quota=True,user_id='c7958fea3a6c429a9526c97871b182a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b059f82-76e8-470f-97d1-3edaeb147bc0),volume_type_id=9b059f82-76e8-470f-97d1-3edaeb147bc0)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Creating volume e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:09 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:10 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 1073741824 Aug 19 00:16:10 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Created reservations ['8027817d-983b-4b1f-8dea-26638efaeeef', '415517b3-0adb-45df-9663-5f830124251c', '58ffbe3f-4b1f-4a70-b421-690c337923f9', '14bd7c8a-15f6-4763-bde3-54ded1247972'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:10 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:10 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:10 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 1G" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Downloaded image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume a0ad4e10-a060-40c1-abdd-6da74f2cf392 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 for user 666bfe710be74d47b8576cfea77eb711 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Marking volume a0ad4e10-a060-40c1-abdd-6da74f2cf392 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Copying metadata from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 to a0ad4e10-a060-40c1-abdd-6da74f2cf392. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Creating volume glance metadata for volume a0ad4e10-a060-40c1-abdd-6da74f2cf392 backed by image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d2b5cb-b5de-434c-9771-a7ebc7ecc9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:10 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc56b101-c188-492f-9f90-7c711cad06a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.415s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Deleted volume successfully. Aug 19 00:16:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Volume volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 (a0ad4e10-a060-40c1-abdd-6da74f2cf392): created successfully Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc56b101-c188-492f-9f90-7c711cad06a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (86c655bb-5e40-4ac4-9448-da041456c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:10 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d73099eb-c7dd-45e7-bcbd-5da2ce761c92 tempest-VolumesCloneTest-1610899518 None] Lock "cinder-7a89d222-9450-4bc0-8654-71f12181fcbc-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a1917251-bca8-457f-ab24-07903953bce8 tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 1073741824" returned: 0 in 0.615s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:10 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 Aug 19 00:16:10 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:11 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6" returned: 0 in 0.469s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4076b4-4765-4dca-b2bc-c9be56a0bb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853c10a2-03dd-437f-9edb-cf2b414495b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Volume volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 (e598cd2e-742f-4db5-a496-3f7b5f7423e6): created successfully Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853c10a2-03dd-437f-9edb-cf2b414495b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Flow 'volume_create_manager' (ceb055da-a31d-4a1e-b8c2-a47da67a0e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3a0ee510-d70e-4d41-bc53-aa9ee1902620 tempest-GroupsV314Test-1587252300 None] Created volume successfully. Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (fee98a1c-35e9-48f8-86eb-d13724bea525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb45239e-8514-4f3f-af24-0ecd732b0ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb45239e-8514-4f3f-af24-0ecd732b0ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-311517870',display_name='tempest-VolumesGetTest-Volume-1998267285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4514ca1-ffbf-4b76-acae-2a6b498a29c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:13Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f36b2c-8e7b-4022-90d0-102d3048665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f36b2c-8e7b-4022-90d0-102d3048665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a3bcaf-e72a-4290-ba48-e06227a40b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a3bcaf-e72a-4290-ba48-e06227a40b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4514ca1-ffbf-4b76-acae-2a6b498a29c2', 'volume_name': 'volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fcbd07-66a2-4072-a349-da2edb988c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fcbd07-66a2-4072-a349-da2edb988c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3701a713-ec75-4ced-8fdb-be4209cb2cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Volume d4514ca1-ffbf-4b76-acae-2a6b498a29c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2', 'volume_size': 1} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-311517870',display_name='tempest-VolumesGetTest-Volume-1998267285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4514ca1-ffbf-4b76-acae-2a6b498a29c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f790844b9b84a13aca66c8efd66e912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:13Z,use_quota=True,user_id='666bfe710be74d47b8576cfea77eb711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Creating volume d4514ca1-ffbf-4b76-acae-2a6b498a29c2 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:12 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:12 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 1073741824 Aug 19 00:16:12 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:13 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:13 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:13 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 1073741824" returned: 0 in 0.865s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:13 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 Aug 19 00:16:13 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:14 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.652s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:16:14 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2" returned: 0 in 0.482s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.455s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:14 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Cloning volume e598cd2e-742f-4db5-a496-3f7b5f7423e6 to volume f93d5408-e502-43b5-b06d-d81dd93f8427 Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3701a713-ec75-4ced-8fdb-be4209cb2cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a290a8aa-976a-485f-990e-e37c3cf262aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Creating offline snapshot a69b1e3d-44ae-454a-8646-391b8ed837ba of volume e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:16:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Volume volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 (d4514ca1-ffbf-4b76-acae-2a6b498a29c2): created successfully Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a290a8aa-976a-485f-990e-e37c3cf262aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Flow 'volume_create_manager' (fee98a1c-35e9-48f8-86eb-d13724bea525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0628a1-80a7-4a95-90c5-6cdfe010e116]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:14 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1c7468f3-2a34-4b7e-b5d1-aa763aa94d5f tempest-VolumesGetTest-177776702 None] Created volume successfully. Aug 19 00:16:14 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 Aug 19 00:16:14 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:14 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6" returned: 0 in 0.559s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:15 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba 1G Aug 19 00:16:15 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-d4514ca1-ffbf-4b76-acae-2a6b498a29c2-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Lock "cinder-d4514ca1-ffbf-4b76-acae-2a6b498a29c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-d4514ca1-ffbf-4b76-acae-2a6b498a29c2" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-d4514ca1-ffbf-4b76-acae-2a6b498a29c2" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093e9fb-6c60-4c5b-9576-5a42d93e583d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:15 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 Aug 19 00:16:15 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:15 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba 1G" returned: 0 in 0.645s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:15 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba Aug 19 00:16:15 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:15 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2" returned: 0 in 0.603s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:16 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2 Aug 19 00:16:16 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:16 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba" returned: 0 in 0.497s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:16 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:16 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba Aug 19 00:16:16 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:16 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4514ca1-ffbf-4b76-acae-2a6b498a29c2" returned: 0 in 0.379s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-d4514ca1-ffbf-4b76-acae-2a6b498a29c2" released by "delete_volume" :: held 1.057s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Created reservations ['893ac5c0-2fc1-458d-a020-da6340edb456', '4bca716d-138b-49b6-9af5-07c832b01e1b', '66cda5e7-6484-4c98-8aae-54cc9333194c', '8fc5a461-8112-480b-a5b7-da689e8d665c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:16 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba" returned: 0 in 0.398s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:16 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:16 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:16 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info Aug 19 00:16:16 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:17 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info" returned: 0 in 0.423s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:17 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:17 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info Aug 19 00:16:17 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:17 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-07bd8707-0748-44ac-91f2-edf6e81761c7 tempest-VolumesGetTest-177776702 None] Lock "cinder-d4514ca1-ffbf-4b76-acae-2a6b498a29c2-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:17 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.info" returned: 0 in 0.287s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Acquiring lock "cinder-quobyte-f93d5408-e502-43b5-b06d-d81dd93f8427" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-f93d5408-e502-43b5-b06d-d81dd93f8427" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] snapshot: a69b1e3d-44ae-454a-8646-391b8ed837ba, volume: f93d5408-e502-43b5-b06d-d81dd93f8427, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c8ec35-0873-49a4-be35-de230c55034a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-a0ad4e10-a060-40c1-abdd-6da74f2cf392-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Lock "cinder-a0ad4e10-a060-40c1-abdd-6da74f2cf392-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:17 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba Aug 19 00:16:17 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Acquiring lock "cinder-quobyte-a0ad4e10-a060-40c1-abdd-6da74f2cf392" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-a0ad4e10-a060-40c1-abdd-6da74f2cf392" acquired by "delete_volume" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab176347-e27d-47b1-988c-80b229588f02]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:17 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 Aug 19 00:16:17 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:17 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba" returned: 0 in 0.558s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15940cc8-41b1-4051-b963-716ef45fae77]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:18 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 Aug 19 00:16:18 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:18 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392" returned: 0 in 0.523s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:18 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392 Aug 19 00:16:18 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:18 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6" returned: 0 in 0.561s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:18 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a0ad4e10-a060-40c1-abdd-6da74f2cf392" returned: 0 in 0.351s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Lock "cinder-quobyte-a0ad4e10-a060-40c1-abdd-6da74f2cf392" released by "delete_volume" :: held 0.932s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:18 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 Aug 19 00:16:18 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Created reservations ['8c7ff109-2a50-436b-9192-125a59270f6e', '64090e9a-c439-4d3c-a048-441f0122f641', '407c9d68-0075-4757-a006-3f213376fee3', 'adc21c90-735b-4671-869d-bea4f115a70f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:18 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:18 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:19 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.910s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:19 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Deleted volume successfully. Aug 19 00:16:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4e91f7f6-c38d-4e23-bb28-6c82a5d5eef4 tempest-VolumesGetTest-177776702 None] Lock "cinder-a0ad4e10-a060-40c1-abdd-6da74f2cf392-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:25 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427" returned: 0 in 6.804s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:16:25 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Converted 1024.00 MB image at 150.45 MB/s Aug 19 00:16:25 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:25 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 Aug 19 00:16:25 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:25 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427" returned: 0 in 0.277s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-f93d5408-e502-43b5-b06d-d81dd93f8427" released by "_copy_volume_from_snapshot" :: held 8.293s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=124,cinder:UPDATE=140,cinder:DELETE=7,cinder:INSERT=36 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Acquiring lock "cinder-quobyte-a69b1e3d-44ae-454a-8646-391b8ed837ba" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-a69b1e3d-44ae-454a-8646-391b8ed837ba" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Deleting offline snapshot a69b1e3d-44ae-454a-8646-391b8ed837ba of volume e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] snapshot_file for this snap is: volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c932c-0917-40f5-997a-3ced3c834fc8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:25 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba Aug 19 00:16:25 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:26 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba" returned: 0 in 0.396s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe77b107-2cd3-44b8-b6b6-b986913a4801]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:26 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 Aug 19 00:16:26 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=144,cinder:INSERT=42,cinder:SELECT=124,cinder:DELETE=13 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Flow 'volume_create_manager' (90506449-076f-467b-85c2-58938a1e70ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d89e46-5cd6-4445-951f-02401386f59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d89e46-5cd6-4445-951f-02401386f59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1058013676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556a864b-2e57-43b3-97e2-796764268afe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5200d26e532740d18181493569cfe97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:26Z,use_quota=True,user_id='63c78a6a7c97412f97597edf86f29855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651519b0-689a-4841-8caf-d5171e0a7cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651519b0-689a-4841-8caf-d5171e0a7cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d161bc34-7eff-4354-93b0-183b1f15df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d161bc34-7eff-4354-93b0-183b1f15df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556a864b-2e57-43b3-97e2-796764268afe', 'volume_name': 'volume-556a864b-2e57-43b3-97e2-796764268afe', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b54ab0e-1e3b-40be-96bf-5d5d774592f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b54ab0e-1e3b-40be-96bf-5d5d774592f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b4865f-b2b4-4abb-8100-5ac2397d765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Volume 556a864b-2e57-43b3-97e2-796764268afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556a864b-2e57-43b3-97e2-796764268afe', 'volume_size': 1} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:26 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6" returned: 0 in 0.647s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:26 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba Aug 19 00:16:26 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:27 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba" returned: 0 in 0.342s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:27 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba Aug 19 00:16:27 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:27 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6.a69b1e3d-44ae-454a-8646-391b8ed837ba" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-a69b1e3d-44ae-454a-8646-391b8ed837ba" released by "_delete_snapshot" :: held 1.746s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.151s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1058013676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556a864b-2e57-43b3-97e2-796764268afe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5200d26e532740d18181493569cfe97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:26Z,use_quota=True,user_id='63c78a6a7c97412f97597edf86f29855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Creating volume 556a864b-2e57-43b3-97e2-796764268afe {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:27 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:27 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe 1073741824 Aug 19 00:16:27 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-51b05af7-34cc-474b-b665-a6286b3122f0 tempest-GroupsV314Test-1587252300 None] Create group from source-group-97de65cc-3f86-455b-97d0-e59b88defc65 completed successfully. Aug 19 00:16:28 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe 1073741824" returned: 0 in 0.598s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:28 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe Aug 19 00:16:28 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:28 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe" returned: 0 in 0.260s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b4865f-b2b4-4abb-8100-5ac2397d765f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556a864b-2e57-43b3-97e2-796764268afe', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc40c92a-fc67-47a7-9019-d923191755bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:28 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Volume volume-556a864b-2e57-43b3-97e2-796764268afe (556a864b-2e57-43b3-97e2-796764268afe): created successfully Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc40c92a-fc67-47a7-9019-d923191755bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Flow 'volume_create_manager' (90506449-076f-467b-85c2-58938a1e70ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-03b4c171-3c6d-4d76-b8a6-21e85f724f8d tempest-VolumesListTestJSON-2072440095 None] Created volume successfully. Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Acquiring lock "cinder-quobyte-f93d5408-e502-43b5-b06d-d81dd93f8427" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-f93d5408-e502-43b5-b06d-d81dd93f8427" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b4a440-a67f-4cc8-a112-277c22251135]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:28 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 Aug 19 00:16:28 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:28 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427" returned: 0 in 0.397s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:28 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427 Aug 19 00:16:28 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:29 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f93d5408-e502-43b5-b06d-d81dd93f8427" returned: 0 in 0.331s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-f93d5408-e502-43b5-b06d-d81dd93f8427" released by "delete_volume" :: held 0.792s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Flow 'volume_create_manager' (856a424d-d3ad-4b79-a85d-674efe2e628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efb2865-5d29-414c-92ae-a7a16216e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efb2865-5d29-414c-92ae-a7a16216e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2129726719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203a0075-584a-4541-a9cf-0c73b47ef5be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5200d26e532740d18181493569cfe97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:29Z,use_quota=True,user_id='63c78a6a7c97412f97597edf86f29855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88ea6a4-110a-4dc1-83fb-af8e7280adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88ea6a4-110a-4dc1-83fb-af8e7280adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad83f309-2bd4-4b56-8f34-8a28ae618614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad83f309-2bd4-4b56-8f34-8a28ae618614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203a0075-584a-4541-a9cf-0c73b47ef5be', 'volume_name': 'volume-203a0075-584a-4541-a9cf-0c73b47ef5be', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104139f8-dd13-4bd1-94a5-71d056d07d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104139f8-dd13-4bd1-94a5-71d056d07d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb79102-5541-4793-a05e-94aad02acdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Volume 203a0075-584a-4541-a9cf-0c73b47ef5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203a0075-584a-4541-a9cf-0c73b47ef5be', 'volume_size': 1} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2129726719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203a0075-584a-4541-a9cf-0c73b47ef5be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5200d26e532740d18181493569cfe97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:29Z,use_quota=True,user_id='63c78a6a7c97412f97597edf86f29855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Creating volume 203a0075-584a-4541-a9cf-0c73b47ef5be {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:29 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:29 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be 1073741824 Aug 19 00:16:29 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Created reservations ['e0ab6bde-19f3-4e23-887c-74e1cfa345ae'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:29 devstack cinder-volume[94243]: WARNING cinder.quota [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1595614705 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1595614705, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:16:29 devstack cinder-volume[94243]: WARNING cinder.quota [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1595614705 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1595614705, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Created reservations ['04119746-e01e-47ed-868f-db454467ffe7', 'fabca4a8-02ca-438f-9da2-1c5c9ea64978', '84a0fe33-d9d1-4a6c-845e-5a27e6d51ff4', 'ef9ced57-2dde-44a3-a530-b28fdfe117d5'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:29 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:29 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:30 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a878fea7-ba51-4303-86cb-71561c6daad7 tempest-GroupsV314Test-1587252300 None] Delete group completed successfully. Aug 19 00:16:30 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be 1073741824" returned: 0 in 0.707s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Acquiring lock "cinder-quobyte-e598cd2e-742f-4db5-a496-3f7b5f7423e6" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-e598cd2e-742f-4db5-a496-3f7b5f7423e6" acquired by "delete_volume" :: waited 0.057s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:30 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be Aug 19 00:16:30 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724c9a3-0412-4577-8dfb-20c6ba115020]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:30 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 Aug 19 00:16:30 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:30 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be" returned: 0 in 0.300s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb79102-5541-4793-a05e-94aad02acdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203a0075-584a-4541-a9cf-0c73b47ef5be', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad8b456-9adc-4354-8b25-6855ca7bc7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:30 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Volume volume-203a0075-584a-4541-a9cf-0c73b47ef5be (203a0075-584a-4541-a9cf-0c73b47ef5be): created successfully Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad8b456-9adc-4354-8b25-6855ca7bc7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Flow 'volume_create_manager' (856a424d-d3ad-4b79-a85d-674efe2e628f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-083338e9-3cc0-4699-bb9c-9dd42a93798c tempest-VolumesListTestJSON-2072440095 None] Created volume successfully. Aug 19 00:16:30 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6" returned: 0 in 0.481s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:30 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6 Aug 19 00:16:30 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:31 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e598cd2e-742f-4db5-a496-3f7b5f7423e6" returned: 0 in 0.241s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Lock "cinder-quobyte-e598cd2e-742f-4db5-a496-3f7b5f7423e6" released by "delete_volume" :: held 0.816s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Created reservations ['f4e20c88-155c-49d8-8ed1-23291919e1ea'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Created reservations ['01671e8d-1026-4a28-9668-1684d53efdd2', 'ad4bf3b4-d91f-4a65-9ef9-1fd7c448ba00', '5efa8b7e-d53e-4eff-a5d4-14acf61f10e6', '3240c15a-f2d2-4226-98e4-271dcf5fff2f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:31 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:31 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:31 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:31 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-43b63d77-0220-482b-97e9-1041a50719bc tempest-GroupsV314Test-1587252300 None] Delete group completed successfully. Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Flow 'volume_create_manager' (5a4ca269-0f92-4f66-bcae-92ddf18f255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5638eda9-4022-4df0-9d90-adc3e0e2d69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5638eda9-4022-4df0-9d90-adc3e0e2d69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1178289640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1313bcb-7440-4916-ad90-dfeff2fc9bd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5200d26e532740d18181493569cfe97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:32Z,use_quota=True,user_id='63c78a6a7c97412f97597edf86f29855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24400b87-b715-4763-83f9-14049496aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24400b87-b715-4763-83f9-14049496aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30246d7c-828c-40ce-a870-8e7896c24a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30246d7c-828c-40ce-a870-8e7896c24a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1313bcb-7440-4916-ad90-dfeff2fc9bd0', 'volume_name': 'volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5669e220-8e84-4cf0-90ca-86a222725cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5669e220-8e84-4cf0-90ca-86a222725cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faaf9ef2-58fb-4bb3-af46-d5bb0958bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:32 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Volume f1313bcb-7440-4916-ad90-dfeff2fc9bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0', 'volume_size': 1} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1178289640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1313bcb-7440-4916-ad90-dfeff2fc9bd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5200d26e532740d18181493569cfe97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:32Z,use_quota=True,user_id='63c78a6a7c97412f97597edf86f29855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Creating volume f1313bcb-7440-4916-ad90-dfeff2fc9bd0 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:32 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:32 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 1073741824 Aug 19 00:16:32 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:32 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 1073741824" returned: 0 in 0.739s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:33 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 Aug 19 00:16:33 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:33 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0" returned: 0 in 0.375s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faaf9ef2-58fb-4bb3-af46-d5bb0958bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7e6ee0-4f85-4851-941d-03698db7a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:33 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Volume volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 (f1313bcb-7440-4916-ad90-dfeff2fc9bd0): created successfully Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7e6ee0-4f85-4851-941d-03698db7a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Flow 'volume_create_manager' (5a4ca269-0f92-4f66-bcae-92ddf18f255f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-fbd7b883-d992-4499-8a88-d607af06a33b tempest-VolumesListTestJSON-2072440095 None] Created volume successfully. Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Flow 'volume_create_manager' (34c005f7-7ce5-45cd-acc8-beadd42ab042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31e49a1-6554-4298-afe0-3e6da596cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31e49a1-6554-4298-afe0-3e6da596cc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-435258851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a76cb4-afab-421f-9997-b95184d87082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc70e6cc4c44e45bff0e82c13a3bf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:36Z,use_quota=True,user_id='eb16e0d7550f40fd8d05d0aedf0b1741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f04536d-bc76-4f46-b1fa-2c2b58348fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f04536d-bc76-4f46-b1fa-2c2b58348fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d4a4ef-d594-4507-b33d-a80dd4c8a372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d4a4ef-d594-4507-b33d-a80dd4c8a372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a76cb4-afab-421f-9997-b95184d87082', 'volume_name': 'volume-69a76cb4-afab-421f-9997-b95184d87082', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33a6fc5-dc55-4472-8dd4-3bb93082aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33a6fc5-dc55-4472-8dd4-3bb93082aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75df3874-edfb-4a98-85a9-22527c168c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Volume 69a76cb4-afab-421f-9997-b95184d87082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a76cb4-afab-421f-9997-b95184d87082', 'volume_size': 1} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-435258851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a76cb4-afab-421f-9997-b95184d87082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc70e6cc4c44e45bff0e82c13a3bf36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:36Z,use_quota=True,user_id='eb16e0d7550f40fd8d05d0aedf0b1741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Creating volume 69a76cb4-afab-421f-9997-b95184d87082 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:36 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:36 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 1073741824 Aug 19 00:16:36 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:36 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 1073741824" returned: 0 in 0.490s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:36 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 Aug 19 00:16:36 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:36 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082" returned: 0 in 0.372s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75df3874-edfb-4a98-85a9-22527c168c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a76cb4-afab-421f-9997-b95184d87082', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df75ec-83ba-4589-a828-c91bd78e13a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Volume volume-69a76cb4-afab-421f-9997-b95184d87082 (69a76cb4-afab-421f-9997-b95184d87082): created successfully Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61df75ec-83ba-4589-a828-c91bd78e13a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Flow 'volume_create_manager' (34c005f7-7ce5-45cd-acc8-beadd42ab042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7bd8832c-4c49-4ed2-b43d-e1434a16d6f9 tempest-AttachVolumeNegativeTest-1110771946 None] Created volume successfully. Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "cinder-f1313bcb-7440-4916-ad90-dfeff2fc9bd0-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-f1313bcb-7440-4916-ad90-dfeff2fc9bd0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "cinder-quobyte-f1313bcb-7440-4916-ad90-dfeff2fc9bd0" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-quobyte-f1313bcb-7440-4916-ad90-dfeff2fc9bd0" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[350afa30-fc23-4136-899c-2e63e26ce6dc]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:37 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 Aug 19 00:16:37 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:37 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0" returned: 0 in 0.404s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:37 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0 Aug 19 00:16:37 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:37 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1313bcb-7440-4916-ad90-dfeff2fc9bd0" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-quobyte-f1313bcb-7440-4916-ad90-dfeff2fc9bd0" released by "delete_volume" :: held 0.786s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Created reservations ['438ad78d-3097-4de4-a1e7-0825e591029e', '2bad6837-7ae0-41f5-90b1-31a979b1f2b1', '681e3e3c-781a-46d7-8b92-eabfb0608285', '0ff8c5dc-24b6-4777-bda0-64d98d62849f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:38 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:38 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "cinder-203a0075-584a-4541-a9cf-0c73b47ef5be-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-203a0075-584a-4541-a9cf-0c73b47ef5be-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "cinder-quobyte-203a0075-584a-4541-a9cf-0c73b47ef5be" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-quobyte-203a0075-584a-4541-a9cf-0c73b47ef5be" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e34b2b-2d38-48c4-b68d-e6baf356cbc2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:38 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be Aug 19 00:16:38 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:38 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.608s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Deleted volume successfully. Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04c09bdb-e001-4899-86d2-6707e2f2f6c7 tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-f1313bcb-7440-4916-ad90-dfeff2fc9bd0-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-50522e1b-4ca8-475b-8893-6900d6a0721d req-fe1bd4b8-7dd8-4f6b-88f1-fa208e065a38 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-50522e1b-4ca8-475b-8893-6900d6a0721d req-fe1bd4b8-7dd8-4f6b-88f1-fa208e065a38 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-50522e1b-4ca8-475b-8893-6900d6a0721d req-fe1bd4b8-7dd8-4f6b-88f1-fa208e065a38 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-50522e1b-4ca8-475b-8893-6900d6a0721d req-fe1bd4b8-7dd8-4f6b-88f1-fa208e065a38 tempest-AttachVolumeNegativeTest-1110771946 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-69a76cb4-afab-421f-9997-b95184d87082', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39b31d6a-03c7-400e-8141-d381410daf2f', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:16:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-50522e1b-4ca8-475b-8893-6900d6a0721d req-fe1bd4b8-7dd8-4f6b-88f1-fa208e065a38 tempest-AttachVolumeNegativeTest-1110771946 None] attachment_update completed successfully. Aug 19 00:16:39 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be" returned: 0 in 0.521s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:39 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be Aug 19 00:16:39 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:39 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-203a0075-584a-4541-a9cf-0c73b47ef5be" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-quobyte-203a0075-584a-4541-a9cf-0c73b47ef5be" released by "delete_volume" :: held 0.944s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Created reservations ['b4c1e747-1547-4078-8f8c-a9df19509dcd', 'aceaed32-b244-4739-8545-714d484bb4f1', '8e47a85e-48ba-4ad0-8e98-67f005c76d2b', '26992386-24a8-441c-9ff8-c42ad5c538ce'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:39 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:39 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:40 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Deleted volume successfully. Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e06218a3-1b98-4aab-a76f-7998c696794a tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-203a0075-584a-4541-a9cf-0c73b47ef5be-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "cinder-556a864b-2e57-43b3-97e2-796764268afe-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-556a864b-2e57-43b3-97e2-796764268afe-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "cinder-quobyte-556a864b-2e57-43b3-97e2-796764268afe" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-quobyte-556a864b-2e57-43b3-97e2-796764268afe" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[475337fe-6de2-462d-a0df-9691da619e5b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:40 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Flow 'volume_create_manager' (fa201caa-cf2f-43fc-bb80-b4506b4f0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:41 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe Aug 19 00:16:41 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d75e5c-ddbe-4564-aeda-671ab3220222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d75e5c-ddbe-4564-aeda-671ab3220222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-189527827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c786e5-bf3e-49f9-99fc-0b77a1d6e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cba1828ada4a4591fdb2536390ca54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:41Z,use_quota=True,user_id='30c030d1231e428c85f45501a79d2d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14c2202-15bf-4814-862f-6c33c6934264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14c2202-15bf-4814-862f-6c33c6934264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fa28aa-c9f8-42ba-aa43-335e6948387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fa28aa-c9f8-42ba-aa43-335e6948387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c786e5-bf3e-49f9-99fc-0b77a1d6e266', 'volume_name': 'volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569dfcd1-b846-4ec8-985a-c8e04e743acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569dfcd1-b846-4ec8-985a-c8e04e743acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3265c-773f-4640-badb-a8ef4ada03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:41 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Volume a6c786e5-bf3e-49f9-99fc-0b77a1d6e266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266', 'volume_size': 1} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-189527827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c786e5-bf3e-49f9-99fc-0b77a1d6e266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cba1828ada4a4591fdb2536390ca54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:41Z,use_quota=True,user_id='30c030d1231e428c85f45501a79d2d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Creating volume a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:41 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:41 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 1073741824 Aug 19 00:16:41 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:41 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe" returned: 0 in 0.438s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:41 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe Aug 19 00:16:41 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:41 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-556a864b-2e57-43b3-97e2-796764268afe" returned: 0 in 0.371s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-quobyte-556a864b-2e57-43b3-97e2-796764268afe" released by "delete_volume" :: held 0.878s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:41 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 1073741824" returned: 0 in 0.666s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Created reservations ['d6b230eb-e5ca-48e3-a145-4dad72d27ab0', '6e8fe57a-34f2-485f-89a5-37267acd8986', '09a87726-e7df-432f-8b35-f8eae035b391', '5352d681-1ebc-453c-8f8b-40471f3f75a4'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:41 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 Aug 19 00:16:41 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:42 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:42 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:42 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266" returned: 0 in 0.453s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3265c-773f-4640-badb-a8ef4ada03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc9bf5c-ed52-496b-ad30-1654d06a4ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:42 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Volume volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 (a6c786e5-bf3e-49f9-99fc-0b77a1d6e266): created successfully Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc9bf5c-ed52-496b-ad30-1654d06a4ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Flow 'volume_create_manager' (fa201caa-cf2f-43fc-bb80-b4506b4f0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:42 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cd0dc8ca-4ba2-4c9f-a431-cdfa11f1950b tempest-VolumeQuotasAdminTestJSON-575261072 None] Created volume successfully. Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.412s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Deleted volume successfully. Aug 19 00:16:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-a1aee8bf-14be-4f7f-8d4e-134ade6c18a5 req-e72b87ea-fbc4-4d89-bb40-83c31c96be6e tempest-AttachVolumeNegativeTest-1110771946 None] Terminate volume connection completed successfully. Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-a1aee8bf-14be-4f7f-8d4e-134ade6c18a5 req-e72b87ea-fbc4-4d89-bb40-83c31c96be6e tempest-AttachVolumeNegativeTest-1110771946 None] Deleting attachment 39b31d6a-03c7-400e-8141-d381410daf2f. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:16:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e5d19db-e08c-4c7d-8a25-4979dcf5ebdb tempest-VolumesListTestJSON-2072440095 None] Lock "cinder-556a864b-2e57-43b3-97e2-796764268afe-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "cinder-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "cinder-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "cinder-quobyte-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "cinder-quobyte-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51bc3fd-7572-4be3-9f5d-70ae80e91e7d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:43 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 Aug 19 00:16:43 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:43 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:43 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266 Aug 19 00:16:43 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:44 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266" returned: 0 in 0.420s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "cinder-quobyte-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266" released by "delete_volume" :: held 0.937s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Created reservations ['02a0c54f-4e6f-46b3-9044-658054f1052e', '14642369-67c1-4184-b690-035d717c7e0d', '86b83910-506f-48d5-9968-6a87d52ab902', 'cea9b6a1-860b-417e-b0e4-5e3ff7aa999e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:44 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:44 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:44 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.374s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Deleted volume successfully. Aug 19 00:16:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82042658-0f38-444c-8b8d-6275acd4bef8 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "cinder-a6c786e5-bf3e-49f9-99fc-0b77a1d6e266-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Flow 'volume_create_manager' (af9d59bb-e28e-438a-8919-82d0e5208f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323f95f7-6518-4626-b9b4-8bfe6a6d8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323f95f7-6518-4626-b9b4-8bfe6a6d8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-839811511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cc766e-44e5-4712-9549-70eff4dae7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cba1828ada4a4591fdb2536390ca54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:46Z,use_quota=True,user_id='30c030d1231e428c85f45501a79d2d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73304b-b71d-4727-a74d-5947d6c47e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73304b-b71d-4727-a74d-5947d6c47e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c35b05-6524-448a-bbf8-a86598816b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c35b05-6524-448a-bbf8-a86598816b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69cc766e-44e5-4712-9549-70eff4dae7f1', 'volume_name': 'volume-69cc766e-44e5-4712-9549-70eff4dae7f1', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3add133e-16d8-438d-83db-3506b56430da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3add133e-16d8-438d-83db-3506b56430da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596098a6-eebd-45d8-8b1a-da964b6c1a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Volume 69cc766e-44e5-4712-9549-70eff4dae7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69cc766e-44e5-4712-9549-70eff4dae7f1', 'volume_size': 1} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-839811511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cc766e-44e5-4712-9549-70eff4dae7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cba1828ada4a4591fdb2536390ca54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:46Z,use_quota=True,user_id='30c030d1231e428c85f45501a79d2d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Creating volume 69cc766e-44e5-4712-9549-70eff4dae7f1 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:46 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:46 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 1073741824 Aug 19 00:16:46 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:47 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 1073741824" returned: 0 in 0.606s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:47 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 Aug 19 00:16:47 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:47 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1" returned: 0 in 0.301s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596098a6-eebd-45d8-8b1a-da964b6c1a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cc766e-44e5-4712-9549-70eff4dae7f1', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d65304-7ffc-467a-a1ba-acf448b6349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Volume volume-69cc766e-44e5-4712-9549-70eff4dae7f1 (69cc766e-44e5-4712-9549-70eff4dae7f1): created successfully Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d65304-7ffc-467a-a1ba-acf448b6349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Flow 'volume_create_manager' (af9d59bb-e28e-438a-8919-82d0e5208f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1dea01b6-e743-4ad3-b60c-07887bf87388 tempest-VolumeQuotasAdminTestJSON-575261072 None] Created volume successfully. Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Flow 'volume_create_manager' (40679501-f19b-433c-9632-971b3b2021fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1321ed14-c942-4ecf-8a36-6c1d348f7025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1321ed14-c942-4ecf-8a36-6c1d348f7025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-898194505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3042eac-a219-4649-8e46-2d4d965b30e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fa56e5dbe0467388e7d79298cc9ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:48Z,use_quota=True,user_id='0d5d135760524a16b43659bcecd754ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e31a74f-45d4-4df1-bba1-148f292846e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e31a74f-45d4-4df1-bba1-148f292846e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17144530-e70e-4031-97b6-01bb88859e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17144530-e70e-4031-97b6-01bb88859e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3042eac-a219-4649-8e46-2d4d965b30e0', 'volume_name': 'volume-d3042eac-a219-4649-8e46-2d4d965b30e0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08656e19-031e-4a79-9da4-44084c8949f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08656e19-031e-4a79-9da4-44084c8949f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382666b1-82d7-470c-a81e-016d49a110cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Volume d3042eac-a219-4649-8e46-2d4d965b30e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3042eac-a219-4649-8e46-2d4d965b30e0', 'volume_size': 1} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-898194505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3042eac-a219-4649-8e46-2d4d965b30e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8fa56e5dbe0467388e7d79298cc9ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:16:48Z,use_quota=True,user_id='0d5d135760524a16b43659bcecd754ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Creating volume d3042eac-a219-4649-8e46-2d4d965b30e0 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:16:48 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:48 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 1073741824 Aug 19 00:16:48 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:48 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 1073741824" returned: 0 in 0.566s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:48 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 Aug 19 00:16:48 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:49 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0" returned: 0 in 0.367s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382666b1-82d7-470c-a81e-016d49a110cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3042eac-a219-4649-8e46-2d4d965b30e0', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef053eba-50ff-463c-9330-97004a3ec95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:16:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Volume volume-d3042eac-a219-4649-8e46-2d4d965b30e0 (d3042eac-a219-4649-8e46-2d4d965b30e0): created successfully Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef053eba-50ff-463c-9330-97004a3ec95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Flow 'volume_create_manager' (40679501-f19b-433c-9632-971b3b2021fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:16:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a52b01c3-71f8-4fb5-bc4c-e7416f2d8b8c tempest-VolumesNegativeTest-808496448 None] Created volume successfully. Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "cinder-69a76cb4-afab-421f-9997-b95184d87082-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-69a76cb4-afab-421f-9997-b95184d87082-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "cinder-quobyte-69a76cb4-afab-421f-9997-b95184d87082" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-quobyte-69a76cb4-afab-421f-9997-b95184d87082" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8abf4a66-958c-413b-8973-b5e845996bb3 tempest-VolumeQuotasAdminTestJSON-676212078 None] Transfer volume completed successfully. Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98d1601-bb55-4f84-8be1-7445fbdfbe7e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:49 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 Aug 19 00:16:49 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:49 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082" returned: 0 in 0.451s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:49 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082 Aug 19 00:16:49 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Acquiring lock "cinder-69cc766e-44e5-4712-9549-70eff4dae7f1-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Lock "cinder-69cc766e-44e5-4712-9549-70eff4dae7f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Acquiring lock "cinder-quobyte-69cc766e-44e5-4712-9549-70eff4dae7f1" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Lock "cinder-quobyte-69cc766e-44e5-4712-9549-70eff4dae7f1" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b4c58-1a5f-4af3-be32-30a2ccef7c7c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:50 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69a76cb4-afab-421f-9997-b95184d87082" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-quobyte-69a76cb4-afab-421f-9997-b95184d87082" released by "delete_volume" :: held 0.830s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:50 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 Aug 19 00:16:50 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Created reservations ['92f49b73-acad-4a09-83a8-5834708642bf', '0e9229b9-2963-4977-b8f8-cf7aa7d60bbc', '27154376-5123-47b3-90da-4dc28b2e5dc1', '5edf5bdc-882e-4393-b31c-dbe69a602964'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:50 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:50 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:50 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1" returned: 0 in 0.516s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "cinder-eb21514d-d060-42ed-a40e-ee27d4ad028f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:50 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1 Aug 19 00:16:50 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-eb21514d-d060-42ed-a40e-ee27d4ad028f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:50 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.362s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Deleted volume successfully. Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "cinder-quobyte-eb21514d-d060-42ed-a40e-ee27d4ad028f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8510b1f-5281-4d8d-bd43-d6558e4f0b40 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-69a76cb4-afab-421f-9997-b95184d87082-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-quobyte-eb21514d-d060-42ed-a40e-ee27d4ad028f" acquired by "delete_volume" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb42d1-d050-4c18-ad24-8448a90bf1a6]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:50 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f Aug 19 00:16:50 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:50 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-69cc766e-44e5-4712-9549-70eff4dae7f1" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Lock "cinder-quobyte-69cc766e-44e5-4712-9549-70eff4dae7f1" released by "delete_volume" :: held 1.022s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Created reservations ['6dd5fd92-b48b-4ff3-8287-89f5da6cbdde', 'c8e92642-5968-4b3c-b8d9-05705809ebf9', '662e37f6-1c7d-4996-b1d2-0437276beff7', 'a27d31e9-bd09-4570-abde-6979a0a0aa57'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:51 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:51 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:51 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f" returned: 0 in 0.502s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:51 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f Aug 19 00:16:51 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:51 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.340s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Deleted volume successfully. Aug 19 00:16:51 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb21514d-d060-42ed-a40e-ee27d4ad028f" returned: 0 in 0.290s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-quobyte-eb21514d-d060-42ed-a40e-ee27d4ad028f" released by "delete_volume" :: held 0.854s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d4cc66de-acdc-46c9-8489-14e56b5a7d2e tempest-VolumeQuotasAdminTestJSON-418150416 None] Lock "cinder-69cc766e-44e5-4712-9549-70eff4dae7f1-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Created reservations ['d772dd31-3949-4c9f-8d74-d099c4fd6ea3', '8c0d0dc8-9dcf-46be-b873-7a34bbf7586a', '6dafedda-e82e-4505-97be-5736c551a82d', '31965861-5f5a-4813-af79-13b02d8ac1dc'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:51 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:51 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:52 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "cinder-100f9ff2-22d4-40d3-872a-8dd6d53cd77c-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.413s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Deleted volume successfully. Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-100f9ff2-22d4-40d3-872a-8dd6d53cd77c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-703df546-14bd-4f16-bb87-472094c324a6 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-eb21514d-d060-42ed-a40e-ee27d4ad028f-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "cinder-quobyte-100f9ff2-22d4-40d3-872a-8dd6d53cd77c" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-quobyte-100f9ff2-22d4-40d3-872a-8dd6d53cd77c" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4ab27e-175a-487c-b4ee-6e8233e5b747]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:52 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c Aug 19 00:16:52 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:52 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c" returned: 0 in 0.587s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:53 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c Aug 19 00:16:53 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:53 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-100f9ff2-22d4-40d3-872a-8dd6d53cd77c" returned: 0 in 0.432s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-quobyte-100f9ff2-22d4-40d3-872a-8dd6d53cd77c" released by "delete_volume" :: held 1.100s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Created reservations ['f3b9fd0d-a5a2-4008-ba40-520c81004d78', '2605acdd-2670-46cb-93e1-cfce69d372e1', '9ac684f5-4376-44b3-bb18-13777479b92c', '59ca1034-d63d-4bc3-8a41-61b341211627'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:16:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:16:53 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:16:53 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:16:54 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Aug 19 00:16:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.400s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:16:54 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:16:54 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Deleted volume successfully. Aug 19 00:16:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-053bd47f-a8b2-4baa-a36f-545920617835 tempest-AttachVolumeNegativeTest-1110771946 None] Lock "cinder-100f9ff2-22d4-40d3-872a-8dd6d53cd77c-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:03 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=119,cinder:SELECT=75,cinder:DELETE=7,cinder:INSERT=25 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:17:04 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=103,cinder:SELECT=85,cinder:INSERT=24,cinder:DELETE=8 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Flow 'volume_create_manager' (dfab885d-94b8-4f99-b2a9-fd186306aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39625d8b-391e-4396-b6c3-bd2cd74c8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39625d8b-391e-4396-b6c3-bd2cd74c8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1610384956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f95d44-7a8b-4dc7-840a-19061ef2e409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef853a3fbb13446ca0641cec6b5ed863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:09Z,use_quota=True,user_id='e3dd7860299b428898a91a89fb0e0976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f71b37e-e476-4bf7-b686-daacaef07a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f71b37e-e476-4bf7-b686-daacaef07a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ddff99-7412-4147-b464-51c9b33dc4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ddff99-7412-4147-b464-51c9b33dc4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f95d44-7a8b-4dc7-840a-19061ef2e409', 'volume_name': 'volume-78f95d44-7a8b-4dc7-840a-19061ef2e409', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459f1645-d87c-4c87-a6ae-23ab1cda6fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459f1645-d87c-4c87-a6ae-23ab1cda6fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6972973-ba98-49e3-a2f2-681776844eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:09 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Volume 78f95d44-7a8b-4dc7-840a-19061ef2e409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f95d44-7a8b-4dc7-840a-19061ef2e409', 'volume_size': 1} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1610384956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f95d44-7a8b-4dc7-840a-19061ef2e409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef853a3fbb13446ca0641cec6b5ed863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:09Z,use_quota=True,user_id='e3dd7860299b428898a91a89fb0e0976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Creating volume 78f95d44-7a8b-4dc7-840a-19061ef2e409 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:09 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:17:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:09 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 1073741824 Aug 19 00:17:09 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:10 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 1073741824" returned: 0 in 1.051s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:10 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 Aug 19 00:17:10 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Flow 'volume_create_manager' (0b7b23c7-1b84-45ab-9bc3-202921cc344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c09cecd-a692-4a5c-a65b-ff6fb5411087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c09cecd-a692-4a5c-a65b-ff6fb5411087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-161519100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c53fc74-0450-4f2f-94f7-5dc7f4de09bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='620cd55c076a44b799254e09e7228202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:11Z,use_quota=True,user_id='cd0357b6be5e4145919cb4f7b2272989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6157b89-804b-4d50-95f9-cbafe17a9d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6157b89-804b-4d50-95f9-cbafe17a9d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a08ec77-a7aa-425c-ad11-84cd62b735f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a08ec77-a7aa-425c-ad11-84cd62b735f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c53fc74-0450-4f2f-94f7-5dc7f4de09bd', 'volume_name': 'volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5526ac6-c4f5-4de3-a720-cac0885d66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5526ac6-c4f5-4de3-a720-cac0885d66a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6ac823-865d-45ab-9a5f-d3676eb56e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Volume 6c53fc74-0450-4f2f-94f7-5dc7f4de09bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd', 'volume_size': 1} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:11 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409" returned: 0 in 0.355s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-161519100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c53fc74-0450-4f2f-94f7-5dc7f4de09bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='620cd55c076a44b799254e09e7228202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:11Z,use_quota=True,user_id='cd0357b6be5e4145919cb4f7b2272989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Creating volume 6c53fc74-0450-4f2f-94f7-5dc7f4de09bd {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:11 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6972973-ba98-49e3-a2f2-681776844eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f95d44-7a8b-4dc7-840a-19061ef2e409', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a83407-debc-4083-ac71-94023e5ed8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:11 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd 1073741824 Aug 19 00:17:11 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Volume volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 (78f95d44-7a8b-4dc7-840a-19061ef2e409): created successfully Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a83407-debc-4083-ac71-94023e5ed8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Flow 'volume_create_manager' (dfab885d-94b8-4f99-b2a9-fd186306aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2a95cdca-ab01-4dd4-a751-49046bd110e9 tempest-TestMinimumBasicScenario-437089586 None] Created volume successfully. Aug 19 00:17:11 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd 1073741824" returned: 0 in 0.724s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:11 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd Aug 19 00:17:12 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:12 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd" returned: 0 in 0.449s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6ac823-865d-45ab-9a5f-d3676eb56e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15972144-51de-46d3-9580-00e0317b8255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Volume volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd (6c53fc74-0450-4f2f-94f7-5dc7f4de09bd): created successfully Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15972144-51de-46d3-9580-00e0317b8255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Flow 'volume_create_manager' (0b7b23c7-1b84-45ab-9bc3-202921cc344c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-5b9fa115-c99a-4da8-a43f-07c31fb62991 req-036f9bff-ae5b-41d6-a79a-91ed5409c777 tempest-VolumesGetTestJSON-926316802 None] Created volume successfully. Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-52a8a0af-9cf1-4162-972c-de012015fe7e req-89dc7307-89bc-4c7e-bccd-88088213d126 tempest-TestMinimumBasicScenario-437089586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-52a8a0af-9cf1-4162-972c-de012015fe7e req-89dc7307-89bc-4c7e-bccd-88088213d126 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-52a8a0af-9cf1-4162-972c-de012015fe7e req-89dc7307-89bc-4c7e-bccd-88088213d126 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-52a8a0af-9cf1-4162-972c-de012015fe7e req-89dc7307-89bc-4c7e-bccd-88088213d126 tempest-TestMinimumBasicScenario-437089586 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-78f95d44-7a8b-4dc7-840a-19061ef2e409', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f26bab5-d417-4128-b281-1f836beea46d', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:13 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:17:13 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-52a8a0af-9cf1-4162-972c-de012015fe7e req-89dc7307-89bc-4c7e-bccd-88088213d126 tempest-TestMinimumBasicScenario-437089586 None] attachment_update completed successfully. Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Acquiring lock "cinder-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Lock "cinder-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:13 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.565s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Acquiring lock "cinder-quobyte-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:17:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Lock "cinder-quobyte-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd" acquired by "delete_volume" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:14 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[74edfc05-9108-45fe-8901-23133e883405]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:14 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd Aug 19 00:17:14 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:14 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd" returned: 0 in 0.574s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:14 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd Aug 19 00:17:14 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:15 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd" returned: 0 in 0.611s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Lock "cinder-quobyte-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd" released by "delete_volume" :: held 1.254s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG cinder.quota [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Created reservations ['10bf2db0-1ba1-478a-90cb-e4c31840284d', '597f06e5-081b-463c-adb8-716a144b6fa5', 'b5021fba-fa78-4751-b6ba-07763d3fb239', 'e55fcc85-ceb0-4db9-89bb-7d912e2fad4f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:15 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:17:15 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:15 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.356s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG cinder.manager [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:17:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Deleted volume successfully. Aug 19 00:17:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-1a49f5c4-27a0-4f30-8f7c-89ea58b9be11 req-230c659d-fb04-46bc-beb7-1544dc5c8ef1 tempest-VolumesGetTestJSON-926316802 None] Lock "cinder-6c53fc74-0450-4f2f-94f7-5dc7f4de09bd-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Acquiring lock "cinder-d3042eac-a219-4649-8e46-2d4d965b30e0-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Lock "cinder-d3042eac-a219-4649-8e46-2d4d965b30e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Acquiring lock "cinder-quobyte-d3042eac-a219-4649-8e46-2d4d965b30e0" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Lock "cinder-quobyte-d3042eac-a219-4649-8e46-2d4d965b30e0" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cb028e-cd8c-4e81-bbd5-9c2f9e3cb557]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:22 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 Aug 19 00:17:22 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:23 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0" returned: 0 in 0.594s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:23 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0 Aug 19 00:17:23 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cb57f1c0-2b9c-4986-ae3a-6097bbd2165d tempest-GroupSnapshotsTest-550348480 None] Group tempest-GroupSnapshotsTest-Group-209081991: creating Aug 19 00:17:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cb57f1c0-2b9c-4986-ae3a-6097bbd2165d tempest-GroupSnapshotsTest-550348480 None] Group tempest-GroupSnapshotsTest-Group-209081991: created successfully Aug 19 00:17:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cb57f1c0-2b9c-4986-ae3a-6097bbd2165d tempest-GroupSnapshotsTest-550348480 None] Create group completed successfully. Aug 19 00:17:23 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d3042eac-a219-4649-8e46-2d4d965b30e0" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Lock "cinder-quobyte-d3042eac-a219-4649-8e46-2d4d965b30e0" released by "delete_volume" :: held 0.934s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Created reservations ['3089ca9f-7a23-47d9-a07b-f3dbea9eeee8', '7dba23d3-7fc2-4afb-934a-875665ffd9a2', '9d479879-3167-47fa-bacf-1308013927f3', 'bd563a29-849c-448b-8173-e46089bbb281'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:23 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:17:23 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:24 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.357s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:17:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Deleted volume successfully. Aug 19 00:17:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f3ff830d-cdd5-46db-a0c3-bcfe877a85ba tempest-VolumesNegativeTest-808496448 None] Lock "cinder-d3042eac-a219-4649-8e46-2d4d965b30e0-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (28970792-55f3-4ab9-ae5a-bfefabd1a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad514d0-4110-41d1-9c80-3cddb2398ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad514d0-4110-41d1-9c80-3cddb2398ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316307906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16a5d7ac-e5d1-4d07-9b97-ff86e2100366,host='devstack@QuobyteHD#QuobyteHD',id=962c21e2-309e-4b03-b63c-5720c4cb3665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:25Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1770e1-f836-4d7a-befd-36bb464bdba9),volume_type_id=4f1770e1-f836-4d7a-befd-36bb464bdba9)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3815a07-738e-466b-bd74-96ba0b8e660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3815a07-738e-466b-bd74-96ba0b8e660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fad4fbc-9a20-4c6c-8af1-7a366fa936a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fad4fbc-9a20-4c6c-8af1-7a366fa936a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962c21e2-309e-4b03-b63c-5720c4cb3665', 'volume_name': 'volume-962c21e2-309e-4b03-b63c-5720c4cb3665', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39889b07-c122-4a7d-88bb-0c98db701260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39889b07-c122-4a7d-88bb-0c98db701260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b6f80-42b9-41ed-aae2-08a3744ad0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Volume 962c21e2-309e-4b03-b63c-5720c4cb3665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962c21e2-309e-4b03-b63c-5720c4cb3665', 'volume_size': 1} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16a5d7ac-e5d1-4d07-9b97-ff86e2100366,created_at=2026-08-18T22:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316307906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16a5d7ac-e5d1-4d07-9b97-ff86e2100366,host='devstack@QuobyteHD#QuobyteHD',id=962c21e2-309e-4b03-b63c-5720c4cb3665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:25Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1770e1-f836-4d7a-befd-36bb464bdba9),volume_type_id=4f1770e1-f836-4d7a-befd-36bb464bdba9)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Creating volume 962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:25 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:25 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 1073741824 Aug 19 00:17:25 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:25 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 1073741824" returned: 0 in 0.612s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:26 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 Aug 19 00:17:26 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:26 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665" returned: 0 in 0.482s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055b6f80-42b9-41ed-aae2-08a3744ad0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962c21e2-309e-4b03-b63c-5720c4cb3665', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049c4fd6-52d8-4ea6-be85-ba1cd559784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Volume volume-962c21e2-309e-4b03-b63c-5720c4cb3665 (962c21e2-309e-4b03-b63c-5720c4cb3665): created successfully Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049c4fd6-52d8-4ea6-be85-ba1cd559784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (28970792-55f3-4ab9-ae5a-bfefabd1a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b2fec9f1-0f88-478e-b2ee-dbe03d9ef3ea tempest-GroupSnapshotsTest-550348480 None] Created volume successfully. Aug 19 00:17:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] GroupSnapshot f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb: creating. Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Group snapshot f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb: creating. {{(pid=94243) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Creating offline snapshot 8d96b193-357f-4f2e-8157-31635edb9f1a of volume 962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaab639-8260-4198-97a0-88cc423f7441]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:28 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 Aug 19 00:17:28 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:28 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665" returned: 0 in 0.514s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:28 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a 1G Aug 19 00:17:28 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:29 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a 1G" returned: 0 in 0.545s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-962c21e2-309e-4b03-b63c-5720c4cb3665 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:29 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-962c21e2-309e-4b03-b63c-5720c4cb3665 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a Aug 19 00:17:29 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:29 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-962c21e2-309e-4b03-b63c-5720c4cb3665 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:29 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:17:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:29 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a Aug 19 00:17:29 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:29 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a" returned: 0 in 0.277s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:29 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info Aug 19 00:17:29 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:30 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info" returned: 0 in 0.280s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:30 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:17:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:30 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info Aug 19 00:17:30 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:30 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.info" returned: 0 in 0.394s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a752d614-605b-4a8a-b730-03b376b81e84 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb: created successfully Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-8d96b193-357f-4f2e-8157-31635edb9f1a-84c40d31-780d-4bb6-bc43-851b10fd50f7" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-8d96b193-357f-4f2e-8157-31635edb9f1a-84c40d31-780d-4bb6-bc43-851b10fd50f7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Creating volume 84c40d31-780d-4bb6-bc43-851b10fd50f7 from snapshot 8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-84c40d31-780d-4bb6-bc43-851b10fd50f7" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-84c40d31-780d-4bb6-bc43-851b10fd50f7" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] snapshot: 8d96b193-357f-4f2e-8157-31635edb9f1a, volume: 84c40d31-780d-4bb6-bc43-851b10fd50f7, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[54355939-b1b1-47e4-818c-0b001fc2e579]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:32 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a Aug 19 00:17:32 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:32 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-962c21e2-309e-4b03-b63c-5720c4cb3665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c6769f-b98c-4ac9-baf6-c06dd078a786]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:32 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 Aug 19 00:17:32 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:33 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665" returned: 0 in 0.458s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:17:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:17:33 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:17:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:33 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 Aug 19 00:17:33 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:39 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7" returned: 0 in 6.164s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:17:39 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Converted 1024.00 MB image at 166.08 MB/s Aug 19 00:17:39 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:39 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 Aug 19 00:17:39 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:39 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-84c40d31-780d-4bb6-bc43-851b10fd50f7" released by "_copy_volume_from_snapshot" :: held 7.563s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-8d96b193-357f-4f2e-8157-31635edb9f1a-84c40d31-780d-4bb6-bc43-851b10fd50f7" released by "_create_volume_from_snapshot" :: held 7.654s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.679s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6d189fd9-4182-4e1c-a0bf-8fab730c01f3 tempest-GroupSnapshotsTest-550348480 None] Create group from source-snapshot-f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb completed successfully. Aug 19 00:17:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-84c40d31-780d-4bb6-bc43-851b10fd50f7" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-84c40d31-780d-4bb6-bc43-851b10fd50f7" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[69491de7-8736-48a0-9c9d-103ebc256eaf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:41 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 Aug 19 00:17:41 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:42 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7" returned: 0 in 0.502s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:42 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7 Aug 19 00:17:42 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:42 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84c40d31-780d-4bb6-bc43-851b10fd50f7" returned: 0 in 0.363s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-84c40d31-780d-4bb6-bc43-851b10fd50f7" released by "delete_volume" :: held 0.931s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Created reservations ['0a862c6f-5430-4370-9dce-dd64e7ad2584'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:42 devstack cinder-volume[94243]: WARNING cinder.quota [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-916182691 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-916182691, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:17:42 devstack cinder-volume[94243]: WARNING cinder.quota [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-916182691 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-916182691, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Created reservations ['f207a612-db68-4f8d-9b13-d964e60c7505', 'ff769102-0b43-480e-985a-6f8a74cebf27', 'e2c49854-e3f2-4797-a5f8-3cfa08fb5f11', 'e18da4da-216a-4bb7-8298-98cce4144b2a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:42 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:17:42 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb: deleting Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb: deleting {{(pid=94243) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-962c21e2-309e-4b03-b63c-5720c4cb3665" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-962c21e2-309e-4b03-b63c-5720c4cb3665" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-8d96b193-357f-4f2e-8157-31635edb9f1a" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-8d96b193-357f-4f2e-8157-31635edb9f1a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Deleting offline snapshot 8d96b193-357f-4f2e-8157-31635edb9f1a of volume 962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:17:43 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] snapshot_file for this snap is: volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.478s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:17:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8b23949e-973f-4fed-b5b3-48d42eed5a5f tempest-GroupSnapshotsTest-550348480 None] Delete group completed successfully. Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[609f8f1f-8b6a-442b-9d99-39495591a10d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:43 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a Aug 19 00:17:43 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:44 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a" returned: 0 in 0.764s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-962c21e2-309e-4b03-b63c-5720c4cb3665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:17:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e656412e-1b73-48d7-a1a8-ca4a86b66b10]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:44 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 Aug 19 00:17:44 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:45 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665" returned: 0 in 1.010s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:45 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a Aug 19 00:17:45 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:45 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a" returned: 0 in 0.500s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:45 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a Aug 19 00:17:45 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:46 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665.8d96b193-357f-4f2e-8157-31635edb9f1a" returned: 0 in 0.490s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-8d96b193-357f-4f2e-8157-31635edb9f1a" released by "_delete_snapshot" :: held 2.931s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-962c21e2-309e-4b03-b63c-5720c4cb3665" released by "delete_snapshot" :: held 2.980s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:46 devstack cinder-volume[94243]: WARNING cinder.quota [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-916182691 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-916182691, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:17:46 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['45fc7519-8ac5-4ce0-a797-727a401b4c95', '993516a8-8ab0-4b4e-b4b5-df85a4605d18', 'cf952460-243a-4a19-b2c8-e509d683b330', '7a8f67bd-1493-44d2-9b79-eec7464b9ed3'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b8dec604-e3fe-412c-9923-6856d6c47319 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f4460ac7-6736-4f1d-bbdd-8b92bb12d0eb: deleted successfully Aug 19 00:17:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-962c21e2-309e-4b03-b63c-5720c4cb3665" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-962c21e2-309e-4b03-b63c-5720c4cb3665" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:47 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c9882e-05b0-4112-ac3c-61a9dd70cd76]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:47 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 Aug 19 00:17:47 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:48 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665" returned: 0 in 0.806s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:48 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665 Aug 19 00:17:48 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:48 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-962c21e2-309e-4b03-b63c-5720c4cb3665" returned: 0 in 0.639s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-962c21e2-309e-4b03-b63c-5720c4cb3665" released by "delete_volume" :: held 1.589s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:48 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['554715ab-2c1e-4a8d-9095-38e3fc56f4d8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:49 devstack cinder-volume[94243]: WARNING cinder.db.api [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-916182691'] Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['5a4768df-78f5-463e-8d46-e9669e04d329', '8b1658c8-a3c2-45a5-a845-87b32f8cb966', '288352c8-ebfd-4d5d-9bc0-7f5b77fd80e5', '8788b0f8-3cef-4c61-9c9b-ffac47a69f39'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (65fc75a0-3e29-4e6d-8395-1ce4281bf28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcec79b-0b82-49dd-9692-c5ebbc68a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcec79b-0b82-49dd-9692-c5ebbc68a50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-682501803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfce1af-3934-409f-bbf1-35b3e1a30164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:49Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8a0528-4528-43c0-9758-478e68bb84b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8a0528-4528-43c0-9758-478e68bb84b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7827063d-f4b6-4cdd-aa8f-197f20cc9e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7827063d-f4b6-4cdd-aa8f-197f20cc9e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfce1af-3934-409f-bbf1-35b3e1a30164', 'volume_name': 'volume-2cfce1af-3934-409f-bbf1-35b3e1a30164', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0cf8b2-da46-4e41-ae14-1b552f7c40bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0cf8b2-da46-4e41-ae14-1b552f7c40bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d91b3c-2e37-488b-a7cd-5b20a5aca8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Volume 2cfce1af-3934-409f-bbf1-35b3e1a30164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfce1af-3934-409f-bbf1-35b3e1a30164', 'volume_size': 1} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-682501803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfce1af-3934-409f-bbf1-35b3e1a30164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:49Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Creating volume 2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:49 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:49 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 1073741824 Aug 19 00:17:49 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:49 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:17:49 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:49 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:17:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-79eeb907-5a56-43ff-801e-6f3ad760ba39 tempest-GroupSnapshotsTest-550348480 None] Delete group completed successfully. Aug 19 00:17:49 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 1073741824" returned: 0 in 0.554s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:49 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 Aug 19 00:17:49 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:50 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164" returned: 0 in 0.383s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d91b3c-2e37-488b-a7cd-5b20a5aca8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfce1af-3934-409f-bbf1-35b3e1a30164', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac70b41-29b4-40b6-8651-33b669817562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Volume volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 (2cfce1af-3934-409f-bbf1-35b3e1a30164): created successfully Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac70b41-29b4-40b6-8651-33b669817562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (65fc75a0-3e29-4e6d-8395-1ce4281bf28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-05434ad5-14c4-4de2-9b23-0a1131511fdc tempest-VolumesSnapshotTestJSON-948643194 None] Created volume successfully. Aug 19 00:17:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2e061d5e-5d29-4ccf-a0a4-e78ea0cd659c tempest-GroupSnapshotsTest-550348480 None] Group tempest-GroupSnapshotsTest-Group-975098505: creating Aug 19 00:17:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2e061d5e-5d29-4ccf-a0a4-e78ea0cd659c tempest-GroupSnapshotsTest-550348480 None] Group tempest-GroupSnapshotsTest-Group-975098505: created successfully Aug 19 00:17:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2e061d5e-5d29-4ccf-a0a4-e78ea0cd659c tempest-GroupSnapshotsTest-550348480 None] Create group completed successfully. Aug 19 00:17:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Creating offline snapshot a6a7deff-7f56-4555-be21-5f133c48d9ea of volume 2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:17:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1885643-83cc-47fd-aa88-b1560a9accae]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:51 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 Aug 19 00:17:51 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:52 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164" returned: 0 in 0.585s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:52 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea 1G Aug 19 00:17:52 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:52 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea 1G" returned: 0 in 0.804s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:53 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea Aug 19 00:17:53 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (1ba28c0b-12a0-408b-bfef-e24a922d6ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c07176-86b5-4aac-9e3c-a40d939bacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c07176-86b5-4aac-9e3c-a40d939bacfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029487107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56aea18f-62b7-4e7b-8e98-c6893abe061b,host='devstack@QuobyteHD#QuobyteHD',id=42ac0b3a-88ad-4917-9224-df87a0461b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:53Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a02e7ac-06be-4f07-ba01-eeb7dde1a409),volume_type_id=5a02e7ac-06be-4f07-ba01-eeb7dde1a409)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4491b9-958d-4b46-81a7-aae567381091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4491b9-958d-4b46-81a7-aae567381091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa843ece-8306-4659-afd2-13dd326787e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa843ece-8306-4659-afd2-13dd326787e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ac0b3a-88ad-4917-9224-df87a0461b8a', 'volume_name': 'volume-42ac0b3a-88ad-4917-9224-df87a0461b8a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225fb0df-f942-486a-928a-2699b3472c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225fb0df-f942-486a-928a-2699b3472c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b331707-5d1b-42cf-889b-3287a53de0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:53 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Volume 42ac0b3a-88ad-4917-9224-df87a0461b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ac0b3a-88ad-4917-9224-df87a0461b8a', 'volume_size': 1} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:53 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea" returned: 0 in 0.562s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:53 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea is being set with open permissions: ugo+rw Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:53 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea Aug 19 00:17:53 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:53 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea" returned: 0 in 0.344s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:53 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info Aug 19 00:17:53 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:54 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:54 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info is being set with open permissions: ugo+rw Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:54 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info Aug 19 00:17:54 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:54 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.info" returned: 0 in 0.296s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56aea18f-62b7-4e7b-8e98-c6893abe061b,created_at=2026-08-18T22:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1029487107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56aea18f-62b7-4e7b-8e98-c6893abe061b,host='devstack@QuobyteHD#QuobyteHD',id=42ac0b3a-88ad-4917-9224-df87a0461b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:53Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a02e7ac-06be-4f07-ba01-eeb7dde1a409),volume_type_id=5a02e7ac-06be-4f07-ba01-eeb7dde1a409)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Creating volume 42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:54 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:17:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:54 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a 1073741824 Aug 19 00:17:54 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:54 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-789fbbd2-e3c0-4baa-a16e-1e31dde1ceae tempest-VolumesSnapshotTestJSON-948643194 None] Create snapshot completed successfully Aug 19 00:17:55 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a 1073741824" returned: 0 in 0.641s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:55 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a Aug 19 00:17:55 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:55 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a" returned: 0 in 0.541s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b331707-5d1b-42cf-889b-3287a53de0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ac0b3a-88ad-4917-9224-df87a0461b8a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e61a99e-5190-4ccc-8844-9d4bbce261bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:55 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Volume volume-42ac0b3a-88ad-4917-9224-df87a0461b8a (42ac0b3a-88ad-4917-9224-df87a0461b8a): created successfully Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e61a99e-5190-4ccc-8844-9d4bbce261bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (1ba28c0b-12a0-408b-bfef-e24a922d6ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-56edfaa6-ef9e-4be0-8674-2612a31114d2 tempest-GroupSnapshotsTest-550348480 None] Created volume successfully. Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-a6a7deff-7f56-4555-be21-5f133c48d9ea-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-a6a7deff-7f56-4555-be21-5f133c48d9ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-2cfce1af-3934-409f-bbf1-35b3e1a30164" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2cfce1af-3934-409f-bbf1-35b3e1a30164" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-a6a7deff-7f56-4555-be21-5f133c48d9ea" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-a6a7deff-7f56-4555-be21-5f133c48d9ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Deleting offline snapshot a6a7deff-7f56-4555-be21-5f133c48d9ea of volume 2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] snapshot_file for this snap is: volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aac435-a0bc-499c-98a2-503991d6dd88]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:56 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea Aug 19 00:17:56 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:56 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea" returned: 0 in 0.398s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cfce1af-3934-409f-bbf1-35b3e1a30164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2e2e79-65ab-49b8-978d-7076a7bc0b7c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:17:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:56 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 Aug 19 00:17:56 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:57 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164" returned: 0 in 0.579s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:57 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea Aug 19 00:17:57 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:57 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea" returned: 0 in 0.511s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:57 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea Aug 19 00:17:57 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (5b78773c-1e61-4aef-a64c-953eb53674d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee0c703-21df-4461-a2dd-56616afc396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:58 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee0c703-21df-4461-a2dd-56616afc396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-797144016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56aea18f-62b7-4e7b-8e98-c6893abe061b,host='devstack@QuobyteHD#QuobyteHD',id=92e9f9ed-3869-40e4-bc90-2f0459f3c9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:58Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a02e7ac-06be-4f07-ba01-eeb7dde1a409),volume_type_id=5a02e7ac-06be-4f07-ba01-eeb7dde1a409)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbd7186-cc76-4abe-923a-e74f8abe3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbd7186-cc76-4abe-923a-e74f8abe3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b723acb-da0a-48b2-b3cf-4464269d20a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b723acb-da0a-48b2-b3cf-4464269d20a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e9f9ed-3869-40e4-bc90-2f0459f3c9d4', 'volume_name': 'volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff73c79c-f8ac-4a72-9f4a-151c7ce7bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff73c79c-f8ac-4a72-9f4a-151c7ce7bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91050948-a3db-4426-a083-6bcc9cde947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:58 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Volume 92e9f9ed-3869-40e4-bc90-2f0459f3c9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4', 'volume_size': 1} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56aea18f-62b7-4e7b-8e98-c6893abe061b,created_at=2026-08-18T22:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-797144016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56aea18f-62b7-4e7b-8e98-c6893abe061b,host='devstack@QuobyteHD#QuobyteHD',id=92e9f9ed-3869-40e4-bc90-2f0459f3c9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:17:58Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a02e7ac-06be-4f07-ba01-eeb7dde1a409),volume_type_id=5a02e7ac-06be-4f07-ba01-eeb7dde1a409)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Creating volume 92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:17:58 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164.a6a7deff-7f56-4555-be21-5f133c48d9ea" returned: 0 in 0.429s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:58 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 1073741824 Aug 19 00:17:58 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-a6a7deff-7f56-4555-be21-5f133c48d9ea" released by "_delete_snapshot" :: held 2.069s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2cfce1af-3934-409f-bbf1-35b3e1a30164" released by "delete_snapshot" :: held 2.099s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['eacb64f4-0be3-4759-bf96-20b460588946', 'e4266f1e-7c86-4d6c-9d83-248fd7107e02', 'd693e982-296a-4cdb-a40c-77423340396e', '37fb5dd0-3b35-4495-9bcf-adcdb65470b2'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:17:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Delete snapshot completed successfully. Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-14f46d36-a63c-4c64-9f07-d7fe6b6cb35a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-a6a7deff-7f56-4555-be21-5f133c48d9ea-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:17:58 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 1073741824" returned: 0 in 0.502s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:17:58 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 Aug 19 00:17:58 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:17:58 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" returned: 0 in 0.296s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91050948-a3db-4426-a083-6bcc9cde947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ca6817-88ac-47d8-b97b-c362dd434759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:58 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Volume volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 (92e9f9ed-3869-40e4-bc90-2f0459f3c9d4): created successfully Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ca6817-88ac-47d8-b97b-c362dd434759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (5b78773c-1e61-4aef-a64c-953eb53674d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:59 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a9791b7a-15eb-460e-bb42-490022e09cd7 tempest-GroupSnapshotsTest-550348480 None] Created volume successfully. Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (bbcb4e94-5a96-4d72-aca5-3f9f88f63926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd23a7a-f981-423f-bb79-f511f4ddb55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd23a7a-f981-423f-bb79-f511f4ddb55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1839800304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf289ce-5f4b-421c-97a8-d34624835825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:00Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb10338-ed37-4bca-92d4-c9a8cfc5e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb10338-ed37-4bca-92d4-c9a8cfc5e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b36be9-97c3-4b94-a6a3-4a96b0829ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b36be9-97c3-4b94-a6a3-4a96b0829ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf289ce-5f4b-421c-97a8-d34624835825', 'volume_name': 'volume-7cf289ce-5f4b-421c-97a8-d34624835825', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246c5eb5-927c-42a2-a917-408f877f09e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246c5eb5-927c-42a2-a917-408f877f09e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37cd149-5811-4d89-8a7d-afd529a1d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:17:59 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Volume 7cf289ce-5f4b-421c-97a8-d34624835825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf289ce-5f4b-421c-97a8-d34624835825', 'volume_size': 1} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1839800304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf289ce-5f4b-421c-97a8-d34624835825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:00Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Creating volume 7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:17:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:00 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:00 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 1073741824 Aug 19 00:18:00 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ee4bfd2d-93ac-4751-890d-4dd8d65486c0 tempest-GroupSnapshotsTest-550348480 None] Update group completed successfully. Aug 19 00:18:00 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 1073741824" returned: 0 in 0.499s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:00 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 Aug 19 00:18:00 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:00 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37cd149-5811-4d89-8a7d-afd529a1d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf289ce-5f4b-421c-97a8-d34624835825', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782a28ee-6efa-48e0-8132-6473d6f0fb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:00 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Volume volume-7cf289ce-5f4b-421c-97a8-d34624835825 (7cf289ce-5f4b-421c-97a8-d34624835825): created successfully Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782a28ee-6efa-48e0-8132-6473d6f0fb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (bbcb4e94-5a96-4d72-aca5-3f9f88f63926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-70b032c3-be2a-47c8-9618-738164e71acd tempest-VolumesSnapshotTestJSON-948643194 None] Created volume successfully. Aug 19 00:18:01 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7bf18ace-1d2b-47be-a2a7-08810b78bb9c tempest-GroupSnapshotsTest-550348480 None] Update group completed successfully. Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Creating offline snapshot c6ddb764-cab7-420f-8826-1e301fbc68bf of volume 7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50a184-7702-4f7c-86e4-580585932eaf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:02 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 Aug 19 00:18:02 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:02 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:02 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf 1G Aug 19 00:18:02 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0d3f1701-b5f0-4ea0-88a5-a6d0f2d1d911 tempest-GroupSnapshotsTest-550348480 None] Update group completed successfully. Aug 19 00:18:03 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf 1G" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf289ce-5f4b-421c-97a8-d34624835825 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:03 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf289ce-5f4b-421c-97a8-d34624835825 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf Aug 19 00:18:03 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:03 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf289ce-5f4b-421c-97a8-d34624835825 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf" returned: 0 in 0.332s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:03 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf is being set with open permissions: ugo+rw Aug 19 00:18:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:03 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf Aug 19 00:18:03 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:04 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=89,cinder:UPDATE=83,cinder:DELETE=7,cinder:INSERT=17 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=94,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=3 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:04 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info Aug 19 00:18:04 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-fbb8f5e7-c0e8-4aed-8699-1a125d7c26f3 tempest-GroupSnapshotsTest-550348480 None] Update group completed successfully. Aug 19 00:18:04 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info" returned: 0 in 0.322s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:04 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info is being set with open permissions: ugo+rw Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:04 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info Aug 19 00:18:04 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:04 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.info" returned: 0 in 0.378s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d50bfc95-56c7-4e61-ba65-b9352a418f91 tempest-VolumesSnapshotTestJSON-948643194 None] Create snapshot completed successfully Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (87882f68-b115-4ccc-a413-c47a6c0b0d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128b9910-e1a8-40d0-9ff4-5b4480e6c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128b9910-e1a8-40d0-9ff4-5b4480e6c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-62005757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a344daa1-56bd-42b3-9079-9058ea7ed765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:05Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a69c8-f327-4efb-970b-af7fa0625aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9a69c8-f327-4efb-970b-af7fa0625aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221ab5d9-299d-402a-8c9e-fecdba47846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221ab5d9-299d-402a-8c9e-fecdba47846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a344daa1-56bd-42b3-9079-9058ea7ed765', 'volume_name': 'volume-a344daa1-56bd-42b3-9079-9058ea7ed765', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317f212b-0d8f-4508-a2bd-62de4ef42c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317f212b-0d8f-4508-a2bd-62de4ef42c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a24a65-fd5b-4550-8cfc-bdcecb2d5c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:05 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Volume a344daa1-56bd-42b3-9079-9058ea7ed765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a344daa1-56bd-42b3-9079-9058ea7ed765', 'volume_size': 1} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-62005757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a344daa1-56bd-42b3-9079-9058ea7ed765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:05Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Creating volume a344daa1-56bd-42b3-9079-9058ea7ed765 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:05 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:05 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 1073741824 Aug 19 00:18:05 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:05 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] GroupSnapshot f9848bde-f40d-47d3-9eca-e9ed3c4a9da3: creating. Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Group snapshot f9848bde-f40d-47d3-9eca-e9ed3c4a9da3: creating. {{(pid=94243) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 19 00:18:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:06 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 1073741824" returned: 0 in 0.712s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (f700f8cc-440d-4294-bd01-02427b004a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd1fa8-2471-4f58-9512-269fb666e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd1fa8-2471-4f58-9512-269fb666e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1389993708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef801bc-c09f-47d4-bcb5-27ff943d528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c6ddb764-cab7-420f-8826-1e301fbc68bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:06Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b244dc-0325-4391-a1d9-7658c9099d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:06 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b244dc-0325-4391-a1d9-7658c9099d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:06 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e00ff-4552-48fa-9938-34e41fcfb28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e00ff-4552-48fa-9938-34e41fcfb28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ef801bc-c09f-47d4-bcb5-27ff943d528e', 'volume_name': 'volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e', 'volume_size': 2, 'snapshot_id': 'c6ddb764-cab7-420f-8826-1e301fbc68bf'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4132883-e202-48b3-9269-20ac32fc251b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4132883-e202-48b3-9269-20ac32fc251b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd2632c-88bc-4e46-8767-accd12074a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:06 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Volume 0ef801bc-c09f-47d4-bcb5-27ff943d528e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e', 'volume_size': 2, 'snapshot_id': 'c6ddb764-cab7-420f-8826-1e301fbc68bf'} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:06 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.804s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Creating offline snapshot 249c8e18-2712-43f6-993e-e0147d5f5b64 of volume 42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a24a65-fd5b-4550-8cfc-bdcecb2d5c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a344daa1-56bd-42b3-9079-9058ea7ed765', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a288ab-dd34-4bca-a962-f3aea064141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba7c19d-8fdd-490b-86ed-980fa6e9a405]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:06 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Volume volume-a344daa1-56bd-42b3-9079-9058ea7ed765 (a344daa1-56bd-42b3-9079-9058ea7ed765): created successfully Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a288ab-dd34-4bca-a962-f3aea064141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (87882f68-b115-4ccc-a413-c47a6c0b0d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:06 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-22be41b7-3fc7-4a3d-8561-7bdf1e75d967 tempest-VolumesActionsTest-445362628 None] Created volume successfully. Aug 19 00:18:06 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a Aug 19 00:18:06 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:07 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a" returned: 0 in 0.401s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:07 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 1G Aug 19 00:18:07 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ac89b503-5cf8-4de4-9d04-232aa1734782 tempest-VolumesActionsTest-445362628 None] Acquiring lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765" by "attach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ac89b503-5cf8-4de4-9d04-232aa1734782 tempest-VolumesActionsTest-445362628 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765" acquired by "attach_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:07 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 1G" returned: 0 in 0.446s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac0b3a-88ad-4917-9224-df87a0461b8a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ac89b503-5cf8-4de4-9d04-232aa1734782 tempest-VolumesActionsTest-445362628 None] Attaching volume a344daa1-56bd-42b3-9079-9058ea7ed765 to instance 847e9045-5074-4d7e-8569-24c184fd7d5e at mountpoint /dev/vdb on host None. Aug 19 00:18:07 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac0b3a-88ad-4917-9224-df87a0461b8a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 Aug 19 00:18:07 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ac89b503-5cf8-4de4-9d04-232aa1734782 tempest-VolumesActionsTest-445362628 None] Attach volume completed successfully. Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ac89b503-5cf8-4de4-9d04-232aa1734782 tempest-VolumesActionsTest-445362628 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765" released by "attach_volume" :: held 0.115s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:07 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42ac0b3a-88ad-4917-9224-df87a0461b8a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64" returned: 0 in 0.325s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:07 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:18:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:08 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 Aug 19 00:18:08 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-011bb57c-47f5-45e0-b6f6-da52154f9629 tempest-VolumesActionsTest-707803788 None] Terminate volume connection completed successfully. Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-011bb57c-47f5-45e0-b6f6-da52154f9629 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-detach_volume" by "detach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-011bb57c-47f5-45e0-b6f6-da52154f9629 tempest-VolumesActionsTest-707803788 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:08 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64" returned: 0 in 0.294s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-011bb57c-47f5-45e0-b6f6-da52154f9629 tempest-VolumesActionsTest-707803788 None] Detaching volume a344daa1-56bd-42b3-9079-9058ea7ed765 from instance 847e9045-5074-4d7e-8569-24c184fd7d5e. Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:08 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info Aug 19 00:18:08 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-011bb57c-47f5-45e0-b6f6-da52154f9629 tempest-VolumesActionsTest-707803788 None] Detach volume completed successfully. Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-011bb57c-47f5-45e0-b6f6-da52154f9629 tempest-VolumesActionsTest-707803788 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-54db7b00-5d61-49ba-adca-b44ddccf1f90 tempest-VolumesActionsTest-445362628 None] Acquiring lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-detach_volume" by "detach_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-54db7b00-5d61-49ba-adca-b44ddccf1f90 tempest-VolumesActionsTest-445362628 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-54db7b00-5d61-49ba-adca-b44ddccf1f90 tempest-VolumesActionsTest-445362628 None] Volume detach called, but volume not attached. Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-54db7b00-5d61-49ba-adca-b44ddccf1f90 tempest-VolumesActionsTest-445362628 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:08 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info" returned: 0 in 0.334s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:08 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:08 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info Aug 19 00:18:08 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Acquiring lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Acquiring lock "cinder-quobyte-a344daa1-56bd-42b3-9079-9058ea7ed765" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Lock "cinder-quobyte-a344daa1-56bd-42b3-9079-9058ea7ed765" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:09 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.info" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[917d43b8-83a9-4217-beb9-59037198f49f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Creating offline snapshot 262af4f2-33a9-438a-a6a6-738f45927fdc of volume 92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a86420-dc31-47b9-9136-091a84c01b06]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:09 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 Aug 19 00:18:09 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:09 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 Aug 19 00:18:09 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:09 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765" returned: 0 in 0.411s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:09 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765 Aug 19 00:18:09 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:09 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" returned: 0 in 0.520s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:09 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc 1G Aug 19 00:18:09 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:09 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a344daa1-56bd-42b3-9079-9058ea7ed765" returned: 0 in 0.363s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Lock "cinder-quobyte-a344daa1-56bd-42b3-9079-9058ea7ed765" released by "delete_volume" :: held 0.853s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:09 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Created reservations ['407866d6-ffb0-4125-aec7-75ee9b0bc3f8', 'cc6595e8-13c8-40f4-8652-81101d572520', 'ea2e104f-09e7-4292-bfff-e6d1890a83d5', '0cc971d9-c031-40c2-a33a-4019ad3a32e7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:10 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:10 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:10 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc 1G" returned: 0 in 0.809s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:10 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc Aug 19 00:18:10 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:10 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.480s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Deleted volume successfully. Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-211371ca-210a-4c03-911d-24a15fda4021 tempest-VolumesActionsTest-445362628 None] Lock "cinder-a344daa1-56bd-42b3-9079-9058ea7ed765-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:10 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc" returned: 0 in 0.481s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:10 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:18:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:11 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc Aug 19 00:18:11 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:11 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc" returned: 0 in 0.456s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:11 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info Aug 19 00:18:11 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:11 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:11 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:18:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:11 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info Aug 19 00:18:11 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:12 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.info" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.044s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.529s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-c6ddb764-cab7-420f-8826-1e301fbc68bf-0ef801bc-c09f-47d4-bcb5-27ff943d528e" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-c6ddb764-cab7-420f-8826-1e301fbc68bf-0ef801bc-c09f-47d4-bcb5-27ff943d528e" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Creating volume 0ef801bc-c09f-47d4-bcb5-27ff943d528e from snapshot c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-0ef801bc-c09f-47d4-bcb5-27ff943d528e" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-0ef801bc-c09f-47d4-bcb5-27ff943d528e" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] snapshot: c6ddb764-cab7-420f-8826-1e301fbc68bf, volume: 0ef801bc-c09f-47d4-bcb5-27ff943d528e, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b798e3d4-8ce3-456d-a7a8-326270448e0d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:12 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf Aug 19 00:18:12 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-22311202-f7f1-426b-95d6-2366c791d139 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f9848bde-f40d-47d3-9eca-e9ed3c4a9da3: created successfully Aug 19 00:18:12 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf" returned: 0 in 0.579s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf289ce-5f4b-421c-97a8-d34624835825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[595afc66-05cd-4a8d-848b-0e6724fb2f47]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:13 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 Aug 19 00:18:13 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:13 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:13 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:13 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-e05ccaad-d720-460a-8198-089a6e4eb03f req-39adfb0e-52cb-4679-9b6a-2475214f78e9 tempest-TestMinimumBasicScenario-437089586 None] Terminate volume connection completed successfully. Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-e05ccaad-d720-460a-8198-089a6e4eb03f req-39adfb0e-52cb-4679-9b6a-2475214f78e9 tempest-TestMinimumBasicScenario-437089586 None] Deleting attachment 9f26bab5-d417-4128-b281-1f836beea46d. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825" returned: 0 in 0.589s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:13 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e Aug 19 00:18:13 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f9848bde-f40d-47d3-9eca-e9ed3c4a9da3: deleting Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f9848bde-f40d-47d3-9eca-e9ed3c4a9da3: deleting {{(pid=94243) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 19 00:18:13 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-42ac0b3a-88ad-4917-9224-df87a0461b8a" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-42ac0b3a-88ad-4917-9224-df87a0461b8a" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-249c8e18-2712-43f6-993e-e0147d5f5b64" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-249c8e18-2712-43f6-993e-e0147d5f5b64" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Deleting offline snapshot 249c8e18-2712-43f6-993e-e0147d5f5b64 of volume 42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] snapshot_file for this snap is: volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b2eebf-93f0-400d-bb28-8ee7b310323c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:14 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 Aug 19 00:18:14 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Acquiring lock "cinder-78f95d44-7a8b-4dc7-840a-19061ef2e409-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Lock "cinder-78f95d44-7a8b-4dc7-840a-19061ef2e409-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:14 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Acquiring lock "cinder-quobyte-78f95d44-7a8b-4dc7-840a-19061ef2e409" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64" returned: 0 in 0.794s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42ac0b3a-88ad-4917-9224-df87a0461b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57919ae5-2669-4043-9264-65a21107d38b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Lock "cinder-quobyte-78f95d44-7a8b-4dc7-840a-19061ef2e409" acquired by "delete_volume" :: waited 0.191s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b36c5-bf54-4e40-91ec-62669367fe46]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:15 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a Aug 19 00:18:15 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:15 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 Aug 19 00:18:15 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (d1e5ae89-8a10-4c77-ad67-13157e431841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86df8b7-d240-482a-8532-9cb387651dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86df8b7-d240-482a-8532-9cb387651dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-377955529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83087ea-285c-430c-bc26-ba739aa691ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:15Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fb92dc-4027-40ff-8d87-67affb4f8a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fb92dc-4027-40ff-8d87-67affb4f8a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7747a34e-1566-4715-a66f-1d9965566e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7747a34e-1566-4715-a66f-1d9965566e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83087ea-285c-430c-bc26-ba739aa691ce', 'volume_name': 'volume-f83087ea-285c-430c-bc26-ba739aa691ce', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad153b3-e9c1-4c0e-8be1-6264ef4bc9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad153b3-e9c1-4c0e-8be1-6264ef4bc9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56323f57-a9f5-44a9-b7c4-0ecd51dab49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:15 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Volume f83087ea-285c-430c-bc26-ba739aa691ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83087ea-285c-430c-bc26-ba739aa691ce', 'volume_size': 1} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a" returned: 0 in 1.029s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:15 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409" returned: 0 in 0.914s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:16 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409 Aug 19 00:18:16 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:16 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 Aug 19 00:18:16 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:16 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64" returned: 0 in 0.888s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:16 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-78f95d44-7a8b-4dc7-840a-19061ef2e409" returned: 0 in 0.968s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:16 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64 Aug 19 00:18:16 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Lock "cinder-quobyte-78f95d44-7a8b-4dc7-840a-19061ef2e409" released by "delete_volume" :: held 2.013s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Created reservations ['73e8e073-f8d0-4ccc-a32b-caad4c8cfc3f', '054cd9c3-1d61-4902-b816-628d6922ef9a', '4617612d-f324-4bb2-b2c3-472f7e02568b', '1c70e15b-0a8b-4317-84a1-4d218bd77525'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:17 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a.249c8e18-2712-43f6-993e-e0147d5f5b64" returned: 0 in 0.708s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:17 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:17 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-249c8e18-2712-43f6-993e-e0147d5f5b64" released by "_delete_snapshot" :: held 3.709s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-42ac0b3a-88ad-4917-9224-df87a0461b8a" released by "delete_snapshot" :: held 3.776s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-262af4f2-33a9-438a-a6a6-738f45927fdc" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-262af4f2-33a9-438a-a6a6-738f45927fdc" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Deleting offline snapshot 262af4f2-33a9-438a-a6a6-738f45927fdc of volume 92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] snapshot_file for this snap is: volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de8cea-08af-428c-a540-e54d0ec676fd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:18 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.624s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:18 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Deleted volume successfully. Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-99222566-4031-453e-bb0b-69e3d0daf258 tempest-TestMinimumBasicScenario-437089586 None] Lock "cinder-78f95d44-7a8b-4dc7-840a-19061ef2e409-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:18 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc Aug 19 00:18:18 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:18 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc" returned: 0 in 0.915s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[471fc8e1-d558-45a0-902c-dd56d1db2a37]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:19 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 Aug 19 00:18:19 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:19 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e" returned: 0 in 5.890s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:18:19 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Converted 1024.00 MB image at 173.78 MB/s Aug 19 00:18:19 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e is being set with open permissions: ugo+rw Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:19 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e Aug 19 00:18:19 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:19 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" returned: 0 in 0.752s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:19 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc Aug 19 00:18:19 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:19 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e" returned: 0 in 0.417s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-0ef801bc-c09f-47d4-bcb5-27ff943d528e" released by "_copy_volume_from_snapshot" :: held 7.601s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-c6ddb764-cab7-420f-8826-1e301fbc68bf-0ef801bc-c09f-47d4-bcb5-27ff943d528e" released by "_create_volume_from_snapshot" :: held 7.700s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.734s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.916s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-377955529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83087ea-285c-430c-bc26-ba739aa691ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:15Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Creating volume f83087ea-285c-430c-bc26-ba739aa691ce {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:19 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd2632c-88bc-4e46-8767-accd12074a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e', 'volume_size': 2, 'snapshot_id': 'c6ddb764-cab7-420f-8826-1e301fbc68bf'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d05000-e3c8-46f4-b73e-621517132713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:19 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce 1073741824 Aug 19 00:18:19 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Volume volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e (0ef801bc-c09f-47d4-bcb5-27ff943d528e): created successfully Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d05000-e3c8-46f4-b73e-621517132713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (f700f8cc-440d-4294-bd01-02427b004a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-93bf82ae-9610-4dfa-adf1-26a9da2b0a9e tempest-VolumesSnapshotTestJSON-948643194 None] Created volume successfully. Aug 19 00:18:20 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc" returned: 0 in 0.566s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:20 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc Aug 19 00:18:20 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:20 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce 1073741824" returned: 0 in 0.656s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:20 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce Aug 19 00:18:20 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:20 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4.262af4f2-33a9-438a-a6a6-738f45927fdc" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-262af4f2-33a9-438a-a6a6-738f45927fdc" released by "_delete_snapshot" :: held 2.873s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" released by "delete_snapshot" :: held 2.920s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:20 devstack cinder-volume[94243]: WARNING cinder.quota [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-891142114 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-891142114, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:18:20 devstack cinder-volume[94243]: WARNING cinder.quota [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-891142114 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-891142114, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['f44e242b-7e0c-44b4-9b59-892859a78577', '65655114-13ee-4c71-84f0-e7670c7422b5', '4f302652-c4db-4483-99dd-cb57eea9149e', 'dda9600d-2033-4dbe-9ac2-646d0b9a9e07'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:20 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce" returned: 0 in 0.308s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56323f57-a9f5-44a9-b7c4-0ecd51dab49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83087ea-285c-430c-bc26-ba739aa691ce', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b1d52e-68cb-48fe-b109-a913e6436d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Volume volume-f83087ea-285c-430c-bc26-ba739aa691ce (f83087ea-285c-430c-bc26-ba739aa691ce): created successfully Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b1d52e-68cb-48fe-b109-a913e6436d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (d1e5ae89-8a10-4c77-ad67-13157e431841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3472aa32-631c-413b-b735-06ded75e337e tempest-VolumesActionsTest-445362628 None] Created volume successfully. Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['ac3798d3-7b93-433c-81a3-934215641ed4', 'fedab6aa-67a0-4c00-883d-547bc8c6b247', 'ae9373a6-2497-4ff8-a57d-0d0ad3675138', 'bb36e5d4-a294-451d-b690-ca2af75d28d4'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-0ef801bc-c09f-47d4-bcb5-27ff943d528e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-0ef801bc-c09f-47d4-bcb5-27ff943d528e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-11173b98-8463-4ad1-9252-f3e1990f71b5 tempest-GroupSnapshotsTest-550348480 None] group_snapshot f9848bde-f40d-47d3-9eca-e9ed3c4a9da3: deleted successfully Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-0ef801bc-c09f-47d4-bcb5-27ff943d528e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-0ef801bc-c09f-47d4-bcb5-27ff943d528e" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c250cce-4cbb-4d18-b50d-c6f76a352784]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:21 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e Aug 19 00:18:21 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-f83087ea-285c-430c-bc26-ba739aa691ce-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Lock "cinder-f83087ea-285c-430c-bc26-ba739aa691ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-quobyte-f83087ea-285c-430c-bc26-ba739aa691ce" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-f83087ea-285c-430c-bc26-ba739aa691ce" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60646f04-c4e6-45cd-aa40-2f27cfc8a6fe]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:21 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e" returned: 0 in 0.400s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:21 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e Aug 19 00:18:21 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:21 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce Aug 19 00:18:21 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:21 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ef801bc-c09f-47d4-bcb5-27ff943d528e" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-0ef801bc-c09f-47d4-bcb5-27ff943d528e" released by "delete_volume" :: held 0.703s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-42ac0b3a-88ad-4917-9224-df87a0461b8a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['4a91352e-a0b4-4dcd-bca9-113f366eb7d8', '5ccb98df-9590-4a6c-95ed-2ad576de25b2', '3f8ef38e-2c22-41d7-9f7a-6abeedc91dd5', 'ab857024-69b5-401a-b2d9-e0eb0fc7ec42'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-42ac0b3a-88ad-4917-9224-df87a0461b8a" acquired by "delete_volume" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:22 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fac6d3-89cb-40d7-ac46-eb72f0b2dd64]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce" returned: 0 in 0.593s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:22 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce Aug 19 00:18:22 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:22 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:22 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:22 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a Aug 19 00:18:22 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-c6ddb764-cab7-420f-8826-1e301fbc68bf-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-c6ddb764-cab7-420f-8826-1e301fbc68bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-7cf289ce-5f4b-421c-97a8-d34624835825" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-7cf289ce-5f4b-421c-97a8-d34624835825" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-c6ddb764-cab7-420f-8826-1e301fbc68bf" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-c6ddb764-cab7-420f-8826-1e301fbc68bf" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Deleting offline snapshot c6ddb764-cab7-420f-8826-1e301fbc68bf of volume 7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] snapshot_file for this snap is: volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[31864806-bedb-42ad-bd61-f5f0a917f8ab]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:22 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:22 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f83087ea-285c-430c-bc26-ba739aa691ce" returned: 0 in 0.444s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Deleted volume successfully. Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-f83087ea-285c-430c-bc26-ba739aa691ce" released by "delete_volume" :: held 1.101s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4f9136b7-06cb-482f-b9f7-bbcdce042552 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-0ef801bc-c09f-47d4-bcb5-27ff943d528e-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Created reservations ['0e67f886-b2b7-44a0-a68d-eb4f1c8a8c43', 'ed19290e-a3c8-4ac2-ba2d-57c9dbcf6e58', '4a21ca3e-0d78-4bf9-a0ce-84c970650c54', '4bc53793-e1bb-48a5-b24d-eb976dff095a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:22 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:22 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a" returned: 0 in 0.613s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:22 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:22 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a Aug 19 00:18:22 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:22 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:22 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:22 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf" returned: 0 in 0.465s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf289ce-5f4b-421c-97a8-d34624835825(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:23 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-42ac0b3a-88ad-4917-9224-df87a0461b8a" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d0fadf-c7de-47ec-a096-7b559a10a61d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:23 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.328s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-42ac0b3a-88ad-4917-9224-df87a0461b8a" released by "delete_volume" :: held 1.101s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Deleted volume successfully. Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" acquired by "delete_volume" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-36caff26-245e-485d-a97b-18c2057b7542 tempest-VolumesActionsTest-707803788 None] Lock "cinder-f83087ea-285c-430c-bc26-ba739aa691ce-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bceedab-fd28-4dfd-9a02-1cb70018893e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:23 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 Aug 19 00:18:23 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:23 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 Aug 19 00:18:23 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:23 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" returned: 0 in 0.401s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:23 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4 Aug 19 00:18:23 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:23 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825" returned: 0 in 0.688s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:23 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf Aug 19 00:18:23 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:23 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-92e9f9ed-3869-40e4-bc90-2f0459f3c9d4" released by "delete_volume" :: held 0.868s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['6935bdbe-ada7-4629-b56e-1fd5e84ab65c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:24 devstack cinder-volume[94243]: WARNING cinder.quota [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-891142114 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-891142114, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['fa3040d2-c174-4b84-806f-24049dbeede4', 'f1d2e52f-35f9-4bf8-a044-2e9a57380f79', '6833308e-e4fe-4363-bb49-8e1dba3588bc', 'a4807cde-37a6-4986-8538-c0ac00412ed7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:24 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf" returned: 0 in 0.531s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:24 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf Aug 19 00:18:24 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['762981c6-af20-4f31-8f0c-869f0ebd653a', 'c8ede880-568d-4ddb-b488-64886b47e5ff', '6a0793ac-f6d5-4c4a-a429-9cb34d780464', '57d95947-0dc9-4ba0-80f4-e61f1a5f77d6'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (ea9faadc-0ede-4191-b97e-69bf8c1aa873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6315a8-8303-4e88-9997-4ece6e6d9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6315a8-8303-4e88-9997-4ece6e6d9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106082785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:24Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31038563-3264-49e1-a60d-e15cc56a0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31038563-3264-49e1-a60d-e15cc56a0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d738866-bff8-4382-82be-d5500b02a136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d738866-bff8-4382-82be-d5500b02a136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d', 'volume_name': 'volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2676da2-5ca1-406c-bec1-aaef14d5d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2676da2-5ca1-406c-bec1-aaef14d5d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c2e012-1309-4383-8394-41a435ae5ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:24 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Volume 3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d', 'volume_size': 1} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-106082785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:24Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Creating volume 3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:24 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:24 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d 1073741824 Aug 19 00:18:24 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:24 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825.c6ddb764-cab7-420f-8826-1e301fbc68bf" returned: 0 in 0.390s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:24 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:24 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-c6ddb764-cab7-420f-8826-1e301fbc68bf" released by "_delete_snapshot" :: held 2.211s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-7cf289ce-5f4b-421c-97a8-d34624835825" released by "delete_snapshot" :: held 2.251s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['c44ddf78-b828-44f0-8cc7-f214107d6477', '850147bf-368e-46d8-a618-05c31c6d441b', 'b502fbe0-002e-418b-89d2-46596de3a515', 'bbba018d-b707-43b1-a1f8-dd831eb067e3'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Delete snapshot completed successfully. Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-647e16ec-5634-46d8-b552-9f9e8c8e7c1d tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-c6ddb764-cab7-420f-8826-1e301fbc68bf-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:24 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.284s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5af079a9-31ff-4c90-98de-f13a7b534c87 tempest-GroupSnapshotsTest-550348480 None] Delete group completed successfully. Aug 19 00:18:25 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d 1073741824" returned: 0 in 0.507s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:25 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d Aug 19 00:18:25 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:25 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c2e012-1309-4383-8394-41a435ae5ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e80032-a613-433a-8f76-637cccc3ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Volume volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d (3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d): created successfully Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e80032-a613-433a-8f76-637cccc3ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (ea9faadc-0ede-4191-b97e-69bf8c1aa873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9c9028dd-6e85-41fe-bfb2-4e3e92178046 tempest-VolumesActionsTest-445362628 None] Created volume successfully. Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-7cf289ce-5f4b-421c-97a8-d34624835825-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-7cf289ce-5f4b-421c-97a8-d34624835825-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-7cf289ce-5f4b-421c-97a8-d34624835825" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-7cf289ce-5f4b-421c-97a8-d34624835825" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1dda60-52c1-403a-b307-c6e18e423479]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:25 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 Aug 19 00:18:25 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c977ddec-17fb-437a-954c-d41b09dda96c tempest-GroupSnapshotsTest-550348480 None] Group tempest-GroupSnapshotsTest-Group-873459522: creating Aug 19 00:18:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c977ddec-17fb-437a-954c-d41b09dda96c tempest-GroupSnapshotsTest-550348480 None] Group tempest-GroupSnapshotsTest-Group-873459522: created successfully Aug 19 00:18:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c977ddec-17fb-437a-954c-d41b09dda96c tempest-GroupSnapshotsTest-550348480 None] Create group completed successfully. Aug 19 00:18:26 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825" returned: 0 in 0.487s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:26 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825 Aug 19 00:18:26 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:26 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7cf289ce-5f4b-421c-97a8-d34624835825" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Lock "cinder-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-7cf289ce-5f4b-421c-97a8-d34624835825" released by "delete_volume" :: held 0.863s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-quobyte-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872142c-eda5-46bc-9355-f4b995457ee2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['ed101425-e4e8-4e41-8450-acaa26e8bcf9', 'c20d676d-c16a-47c2-959f-96658a680ac7', '471f9da3-9016-46ee-a7ba-3661d8d4b8cf', '27f6135d-d502-4afa-885a-70068161a2c5'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:26 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d Aug 19 00:18:26 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:26 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:26 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:27 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.357s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Deleted volume successfully. Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1165fa11-9a52-46f2-9c01-bc71a9f67a2a tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-7cf289ce-5f4b-421c-97a8-d34624835825-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:27 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d" returned: 0 in 0.666s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:27 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d Aug 19 00:18:27 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (49fd1a32-c62c-4c64-8c9f-b39f7a3f4622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0267a1f-b17d-4f33-9305-ec5c80a30953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0267a1f-b17d-4f33-9305-ec5c80a30953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1392237110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef52252-af1b-41b3-8900-b65634e0c7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:28Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4f48ae-e574-4a56-80f4-e4efb90a31f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4f48ae-e574-4a56-80f4-e4efb90a31f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751be460-a111-4bb2-b1d8-010de7abfe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751be460-a111-4bb2-b1d8-010de7abfe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef52252-af1b-41b3-8900-b65634e0c7bf', 'volume_name': 'volume-2ef52252-af1b-41b3-8900-b65634e0c7bf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adf370e-5cd9-47c0-aa89-84c965df25a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adf370e-5cd9-47c0-aa89-84c965df25a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0330f096-ecc1-4e7a-97e6-6fbe6c8c5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Volume 2ef52252-af1b-41b3-8900-b65634e0c7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef52252-af1b-41b3-8900-b65634e0c7bf', 'volume_size': 1} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1392237110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef52252-af1b-41b3-8900-b65634e0c7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:28Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Creating volume 2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:27 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:27 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:27 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf 1073741824 Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d" released by "delete_volume" :: held 1.033s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:27 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Created reservations ['640f6638-19c3-4745-8cdc-abb77b74d8e7', '08246826-06cb-40f9-8c23-d9330b2ec1e3', '0a30c037-96f1-4934-be9a-70330d56f426', 'ff44f017-cce6-4ab5-a8bc-24f588d8d732'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:28 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:28 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (4336acd5-39fb-497d-9213-294505a29bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e96780b-6049-4622-a686-3255be437dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e96780b-6049-4622-a686-3255be437dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405772840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a01dd5f9-7ffb-42ad-a46d-f6868810aedb,host='devstack@QuobyteHD#QuobyteHD',id=6cbfceee-40d5-4ed5-b229-8e6177f9ed6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:28Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(934f11fe-873c-4e32-b5a8-adaa08fe3c68),volume_type_id=934f11fe-873c-4e32-b5a8-adaa08fe3c68)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e70ca7-9186-4ba5-8aa3-580d879f3c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e70ca7-9186-4ba5-8aa3-580d879f3c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf16d3af-a855-4a8d-af6b-1a4940cafc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf16d3af-a855-4a8d-af6b-1a4940cafc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbfceee-40d5-4ed5-b229-8e6177f9ed6a', 'volume_name': 'volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279b3865-0e6a-4065-9362-6d7d8fb61f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279b3865-0e6a-4065-9362-6d7d8fb61f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691bb891-95f3-496f-8e56-885dc1f73c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:28 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Volume 6cbfceee-40d5-4ed5-b229-8e6177f9ed6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a', 'volume_size': 1} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:28 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf 1073741824" returned: 0 in 0.573s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:28 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.324s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Deleted volume successfully. Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ebbd7096-b13b-4434-9302-d5eeced5bae1 tempest-VolumesActionsTest-707803788 None] Lock "cinder-3b16dbe0-ed45-4eb4-89ba-1ab3fa7a275d-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:28 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf Aug 19 00:18:28 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:28 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf" returned: 0 in 0.263s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a01dd5f9-7ffb-42ad-a46d-f6868810aedb,created_at=2026-08-18T22:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405772840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a01dd5f9-7ffb-42ad-a46d-f6868810aedb,host='devstack@QuobyteHD#QuobyteHD',id=6cbfceee-40d5-4ed5-b229-8e6177f9ed6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2361689953534d4e9fd540cf0b90e9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:28Z,use_quota=True,user_id='f009cdfd7d234190a0a3c9a5210d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(934f11fe-873c-4e32-b5a8-adaa08fe3c68),volume_type_id=934f11fe-873c-4e32-b5a8-adaa08fe3c68)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Creating volume 6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:28 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:28 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a 1073741824 Aug 19 00:18:28 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0330f096-ecc1-4e7a-97e6-6fbe6c8c5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef52252-af1b-41b3-8900-b65634e0c7bf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71590126-ebe1-40eb-a340-b7887dcb5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:28 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Volume volume-2ef52252-af1b-41b3-8900-b65634e0c7bf (2ef52252-af1b-41b3-8900-b65634e0c7bf): created successfully Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71590126-ebe1-40eb-a340-b7887dcb5423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (49fd1a32-c62c-4c64-8c9f-b39f7a3f4622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5373fd41-605d-4764-b868-363e8a635b82 tempest-VolumesSnapshotTestJSON-948643194 None] Created volume successfully. Aug 19 00:18:29 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a 1073741824" returned: 0 in 0.548s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:29 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a Aug 19 00:18:29 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:29 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" returned: 0 in 0.312s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691bb891-95f3-496f-8e56-885dc1f73c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e678b160-b6ee-45ba-ab76-6072c6236aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (9af396d3-adf0-4f95-80a3-1f10eeb7e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc89a65-11c7-4e86-8f1c-1fd08a035dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Volume volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a (6cbfceee-40d5-4ed5-b229-8e6177f9ed6a): created successfully Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e678b160-b6ee-45ba-ab76-6072c6236aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Flow 'volume_create_manager' (4336acd5-39fb-497d-9213-294505a29bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc89a65-11c7-4e86-8f1c-1fd08a035dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-384949646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c61b91a-4774-49d1-88cc-66c182063a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:29Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e23b35b-b86f-429f-8108-9f650b7a2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e23b35b-b86f-429f-8108-9f650b7a2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6433be27-a341-4016-b476-8ff9a28b5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6433be27-a341-4016-b476-8ff9a28b5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c61b91a-4774-49d1-88cc-66c182063a67', 'volume_name': 'volume-8c61b91a-4774-49d1-88cc-66c182063a67', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba4e614-965c-47c2-9ba7-feee975e47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba4e614-965c-47c2-9ba7-feee975e47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1261c37b-2b46-41d7-a3c1-6d0eafe7d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Volume 8c61b91a-4774-49d1-88cc-66c182063a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c61b91a-4774-49d1-88cc-66c182063a67', 'volume_size': 1} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-384949646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c61b91a-4774-49d1-88cc-66c182063a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:29Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Creating volume 8c61b91a-4774-49d1-88cc-66c182063a67 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:29 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0be809da-090d-4636-8ea8-33a963f77b94 tempest-GroupSnapshotsTest-550348480 None] Created volume successfully. Aug 19 00:18:29 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 1073741824 Aug 19 00:18:29 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:30 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 1073741824" returned: 0 in 0.570s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:30 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 Aug 19 00:18:30 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:30 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67" returned: 0 in 0.271s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.691s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Creating offline snapshot a68ca5d4-e804-4bbb-9a75-ad5e275fa51b of volume 2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1261c37b-2b46-41d7-a3c1-6d0eafe7d909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c61b91a-4774-49d1-88cc-66c182063a67', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b19306-57b8-479b-8e61-aa7d14b0ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae40c0a-70ee-459a-9695-d98239249921]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:30 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Volume volume-8c61b91a-4774-49d1-88cc-66c182063a67 (8c61b91a-4774-49d1-88cc-66c182063a67): created successfully Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b19306-57b8-479b-8e61-aa7d14b0ee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (9af396d3-adf0-4f95-80a3-1f10eeb7e1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d72a4347-881f-4e22-b77f-624bd56acead tempest-VolumesActionsTest-445362628 None] Created volume successfully. Aug 19 00:18:30 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf Aug 19 00:18:30 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] GroupSnapshot 5e740351-f6b5-4543-a016-f3257e0aea76: creating. Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Group snapshot 5e740351-f6b5-4543-a016-f3257e0aea76: creating. {{(pid=94243) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 19 00:18:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:31 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf" returned: 0 in 0.460s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:31 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b 1G Aug 19 00:18:31 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:31 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b 1G" returned: 0 in 0.382s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef52252-af1b-41b3-8900-b65634e0c7bf -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:31 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef52252-af1b-41b3-8900-b65634e0c7bf -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b Aug 19 00:18:31 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-8c61b91a-4774-49d1-88cc-66c182063a67-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:31 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef52252-af1b-41b3-8900-b65634e0c7bf -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" returned: 0 in 0.331s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:31 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b is being set with open permissions: ugo+rw Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:31 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b Aug 19 00:18:31 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Lock "cinder-8c61b91a-4774-49d1-88cc-66c182063a67-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-quobyte-8c61b91a-4774-49d1-88cc-66c182063a67" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-8c61b91a-4774-49d1-88cc-66c182063a67" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d0313-3289-48ad-bc57-07c96adf34c3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:32 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 Aug 19 00:18:32 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:32 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" returned: 0 in 0.402s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:32 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info Aug 19 00:18:32 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:32 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:32 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67 Aug 19 00:18:32 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:32 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info" returned: 0 in 0.264s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:32 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info is being set with open permissions: ugo+rw Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:32 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info Aug 19 00:18:32 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:32 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8c61b91a-4774-49d1-88cc-66c182063a67" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-8c61b91a-4774-49d1-88cc-66c182063a67" released by "delete_volume" :: held 0.784s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:32 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Created reservations ['15e818ca-d2db-4cf3-80a9-a66ece99f887', '07d321d3-b087-4e64-850d-a82c62ab7606', '727b51a2-25a8-4ab1-86f9-5a43b009efa5', 'c9189eb5-c94b-4a11-98aa-09eccd65af30'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.info" returned: 0 in 0.302s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.998s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Creating offline snapshot 4f429be3-9017-4461-95ed-32851430d0b4 of volume 6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b531355e-93c9-4c3b-9c1f-43a05a562bb9]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-13dee6bf-5dad-4705-bc38-bd79c7178257 tempest-VolumesSnapshotTestJSON-948643194 None] Create snapshot completed successfully Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:33 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a Aug 19 00:18:33 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:33 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:33 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:33 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.318s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Deleted volume successfully. Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c30487b4-c47d-474a-8373-d0f8e0f5d8b4 tempest-VolumesActionsTest-707803788 None] Lock "cinder-8c61b91a-4774-49d1-88cc-66c182063a67-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:33 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" returned: 0 in 0.592s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:33 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 1G Aug 19 00:18:33 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (cdf27313-5968-4c5c-b008-60b2f40b23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db9e623-b29e-411d-a049-5090c5862d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db9e623-b29e-411d-a049-5090c5862d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609125094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1090cc-2b9c-4619-90ba-9db7a19e4aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:34Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7e1c08-73a1-41fb-81bd-8d5514cc39a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:33 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7e1c08-73a1-41fb-81bd-8d5514cc39a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0517c5fc-1993-4481-a77b-82e9ee65720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0517c5fc-1993-4481-a77b-82e9ee65720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1090cc-2b9c-4619-90ba-9db7a19e4aea', 'volume_name': 'volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433a1d07-0865-4d21-84f9-f14595307174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433a1d07-0865-4d21-84f9-f14595307174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96fc8024-d65b-4744-8c9e-216eabe53666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:33 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Volume 8d1090cc-2b9c-4619-90ba-9db7a19e4aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea', 'volume_size': 1} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 1G" returned: 0 in 0.518s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:33 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 Aug 19 00:18:33 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:33 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (16fa6075-9b15-4df8-8fea-124f2bdb93fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249cd8e2-e96e-46d8-a91e-2168dc1f46d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249cd8e2-e96e-46d8-a91e-2168dc1f46d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1939585976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16cf6be-8167-4c31-b8a9-a753e6526f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff53a33404c84e14807eb4c57c96812f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a68ca5d4-e804-4bbb-9a75-ad5e275fa51b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:34Z,use_quota=True,user_id='6d59140261f640fc94e5e638b1b1d3b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16127994-1e7c-4a75-abf3-47fc906f4234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16127994-1e7c-4a75-abf3-47fc906f4234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a789f4-67db-4389-9884-d2739d4f4e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a789f4-67db-4389-9884-d2739d4f4e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b16cf6be-8167-4c31-b8a9-a753e6526f4e', 'volume_name': 'volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e', 'volume_size': 1, 'snapshot_id': 'a68ca5d4-e804-4bbb-9a75-ad5e275fa51b'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e46709f-97a1-4219-9595-13b9adfdcb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e46709f-97a1-4219-9595-13b9adfdcb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f307867-d24f-4bda-9b80-ac583bce7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Volume b16cf6be-8167-4c31-b8a9-a753e6526f4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e', 'volume_size': 1, 'snapshot_id': 'a68ca5d4-e804-4bbb-9a75-ad5e275fa51b'} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:34 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4" returned: 0 in 0.345s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:34 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:34 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 Aug 19 00:18:34 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:34 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4" returned: 0 in 0.267s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:34 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info Aug 19 00:18:34 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:34 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info" returned: 0 in 0.268s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:34 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 19 00:18:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:34 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info Aug 19 00:18:34 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:35 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.info" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1609125094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1090cc-2b9c-4619-90ba-9db7a19e4aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:34Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Creating volume 8d1090cc-2b9c-4619-90ba-9db7a19e4aea {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:35 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:35 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea 1073741824 Aug 19 00:18:35 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bf0e6f5c-38c8-46db-a68d-ed68575cec7f tempest-GroupSnapshotsTest-550348480 None] group_snapshot 5e740351-f6b5-4543-a016-f3257e0aea76: created successfully Aug 19 00:18:35 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea 1073741824" returned: 0 in 0.476s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:35 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea Aug 19 00:18:35 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:35 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.839s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b-b16cf6be-8167-4c31-b8a9-a753e6526f4e" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96fc8024-d65b-4744-8c9e-216eabe53666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83ca2e7-e0cf-4e81-a3e0-90a3a4d0f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b-b16cf6be-8167-4c31-b8a9-a753e6526f4e" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Creating volume b16cf6be-8167-4c31-b8a9-a753e6526f4e from snapshot a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-b16cf6be-8167-4c31-b8a9-a753e6526f4e" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Volume volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea (8d1090cc-2b9c-4619-90ba-9db7a19e4aea): created successfully Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83ca2e7-e0cf-4e81-a3e0-90a3a4d0f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (cdf27313-5968-4c5c-b008-60b2f40b23f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-b16cf6be-8167-4c31-b8a9-a753e6526f4e" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] snapshot: a68ca5d4-e804-4bbb-9a75-ad5e275fa51b, volume: b16cf6be-8167-4c31-b8a9-a753e6526f4e, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:18:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a418517a-3b6b-453f-9ca3-f90c7b12ab51 tempest-VolumesActionsTest-445362628 None] Created volume successfully. Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc46b68-c661-4f94-b505-18765f9876e6]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:36 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b Aug 19 00:18:36 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] group_snapshot 5e740351-f6b5-4543-a016-f3257e0aea76: deleting Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] group_snapshot 5e740351-f6b5-4543-a016-f3257e0aea76: deleting {{(pid=94243) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-4f429be3-9017-4461-95ed-32851430d0b4" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-4f429be3-9017-4461-95ed-32851430d0b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Deleting offline snapshot 4f429be3-9017-4461-95ed-32851430d0b4 of volume 6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] snapshot_file for this snap is: volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffe4f0-8eaa-43ef-96bd-1ebcb2f8af65]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:36 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 Aug 19 00:18:36 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:36 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" returned: 0 in 0.472s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef52252-af1b-41b3-8900-b65634e0c7bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[238cddf2-a507-4b0f-862f-ca05a1548e19]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:36 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf Aug 19 00:18:36 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:36 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4" returned: 0 in 0.507s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b234acb0-3269-4d57-8d2b-4759d95e400b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-8d1090cc-2b9c-4619-90ba-9db7a19e4aea-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Lock "cinder-8d1090cc-2b9c-4619-90ba-9db7a19e4aea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Acquiring lock "cinder-quobyte-8d1090cc-2b9c-4619-90ba-9db7a19e4aea" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-8d1090cc-2b9c-4619-90ba-9db7a19e4aea" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:37 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf" returned: 0 in 0.547s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:18:37 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a Aug 19 00:18:37 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dd245c-06a3-41c6-b4cd-efe0962b75cd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:37 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e Aug 19 00:18:37 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:37 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea Aug 19 00:18:37 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:37 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:37 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 Aug 19 00:18:37 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:37 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea" returned: 0 in 0.509s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:37 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea Aug 19 00:18:37 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:38 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4" returned: 0 in 0.549s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:38 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4 Aug 19 00:18:38 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:38 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8d1090cc-2b9c-4619-90ba-9db7a19e4aea" returned: 0 in 0.494s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Lock "cinder-quobyte-8d1090cc-2b9c-4619-90ba-9db7a19e4aea" released by "delete_volume" :: held 1.105s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Created reservations ['52c18004-2272-4982-bab7-d9ff58eabd06', '8e4d0a61-dc0a-448b-a72a-a0f033e350cc', '990a5a25-d530-44a5-af55-441d56679240', 'b39d47c8-af30-4433-98c2-dadb39fff790'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:38 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:38 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:38 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a.4f429be3-9017-4461-95ed-32851430d0b4" returned: 0 in 0.867s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-4f429be3-9017-4461-95ed-32851430d0b4" released by "_delete_snapshot" :: held 2.633s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" released by "delete_snapshot" :: held 2.664s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:39 devstack cinder-volume[94243]: WARNING cinder.quota [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1230843761 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1230843761, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:18:39 devstack cinder-volume[94243]: WARNING cinder.quota [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1230843761 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1230843761, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:18:39 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.635s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:39 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:39 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['cc40c775-953c-4b53-8a23-b6fa12faa7b4', '4671c99e-eb06-46a0-b48c-a872a15310ab', '3852d18f-097e-4588-9400-6a3602e7c3c1', 'ccbf2738-68ba-4407-bac6-fda885b6348c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Deleted volume successfully. Aug 19 00:18:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-699fcc30-fdcc-4899-a17c-3d060b3a5130 tempest-VolumesActionsTest-707803788 None] Lock "cinder-8d1090cc-2b9c-4619-90ba-9db7a19e4aea-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-96c25269-6fc4-4fee-a641-493df43c3408 tempest-GroupSnapshotsTest-550348480 None] group_snapshot 5e740351-f6b5-4543-a016-f3257e0aea76: deleted successfully Aug 19 00:18:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "cinder-quobyte-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" acquired by "delete_volume" :: waited 0.083s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (3113b5ce-b2f2-4e6b-890a-59b0f7a34378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af00e26a-3f89-4bf0-bbb8-09aec8157acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7debb727-bc3a-4870-bb5c-3549f0c8f2a5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af00e26a-3f89-4bf0-bbb8-09aec8157acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441435351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbca03f-3b86-4043-bb64-72dd62b8f7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:41Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322eda90-35ee-4d12-b94c-2e1b67c35186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322eda90-35ee-4d12-b94c-2e1b67c35186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8047dc-0565-4a00-b909-d7c4385c1472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8047dc-0565-4a00-b909-d7c4385c1472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbca03f-3b86-4043-bb64-72dd62b8f7fe', 'volume_name': 'volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76fac3e-10a0-4bc1-b33e-183696b1f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76fac3e-10a0-4bc1-b33e-183696b1f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68614b2-3b72-43f4-90a8-53ec3d42fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:41 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Volume 2cbca03f-3b86-4043-bb64-72dd62b8f7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe', 'volume_size': 1} Aug 19 00:18:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:41 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a Aug 19 00:18:41 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:42 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" returned: 0 in 0.920s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:42 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a Aug 19 00:18:42 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:42 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" returned: 0 in 0.438s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Lock "cinder-quobyte-6cbfceee-40d5-4ed5-b229-8e6177f9ed6a" released by "delete_volume" :: held 1.641s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['3ca60287-9495-41c1-8e63-2d0ba54e7613'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:42 devstack cinder-volume[94243]: WARNING cinder.quota [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1230843761 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1230843761, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:18:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Created reservations ['5b56779a-6089-4dc7-a4da-49b43ab54a63', '29cb3653-7951-4a65-9745-75d1178817da', 'ad72d54a-0cd4-41d7-9a64-eb4a0135a285', '3dd890fc-0dba-4c17-a6b9-8d6013f88ed3'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:43 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:43 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:43 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e" returned: 0 in 6.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:18:43 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Converted 1024.00 MB image at 163.35 MB/s Aug 19 00:18:43 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e is being set with open permissions: ugo+rw Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:43 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e Aug 19 00:18:43 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:43 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-eb81df6e-1375-4a4a-902f-911dd79bc355 tempest-GroupSnapshotsTest-550348480 None] Delete group completed successfully. Aug 19 00:18:43 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e" returned: 0 in 0.291s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-b16cf6be-8167-4c31-b8a9-a753e6526f4e" released by "_copy_volume_from_snapshot" :: held 7.696s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b-b16cf6be-8167-4c31-b8a9-a753e6526f4e" released by "_create_volume_from_snapshot" :: held 7.814s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.850s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441435351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbca03f-3b86-4043-bb64-72dd62b8f7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecbd63ad93b4015876376aff586dedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:18:41Z,use_quota=True,user_id='892803a6b65f4cd2a4570b0d4fe28fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Creating volume 2cbca03f-3b86-4043-bb64-72dd62b8f7fe {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:18:43 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:43 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe 1073741824 Aug 19 00:18:43 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f307867-d24f-4bda-9b80-ac583bce7df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e', 'volume_size': 1, 'snapshot_id': 'a68ca5d4-e804-4bbb-9a75-ad5e275fa51b'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b09f02-1820-4a3c-a7ea-e261737fbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:43 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Volume volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e (b16cf6be-8167-4c31-b8a9-a753e6526f4e): created successfully Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b09f02-1820-4a3c-a7ea-e261737fbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Flow 'volume_create_manager' (16fa6075-9b15-4df8-8fea-124f2bdb93fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-76703ff1-877c-4650-bfbf-03b36eeb1870 tempest-VolumesSnapshotTestJSON-948643194 None] Created volume successfully. Aug 19 00:18:44 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe 1073741824" returned: 0 in 0.576s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:44 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe Aug 19 00:18:44 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:44 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe" returned: 0 in 0.344s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68614b2-3b72-43f4-90a8-53ec3d42fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeccc2b5-3989-4e0a-99fb-7d501f1c3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:18:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Volume volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe (2cbca03f-3b86-4043-bb64-72dd62b8f7fe): created successfully Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeccc2b5-3989-4e0a-99fb-7d501f1c3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:18:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Flow 'volume_create_manager' (3113b5ce-b2f2-4e6b-890a-59b0f7a34378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:18:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-110f7f16-a469-4062-9dda-3d13d7c79edd tempest-VolumesActionsTest-445362628 None] Created volume successfully. Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-b16cf6be-8167-4c31-b8a9-a753e6526f4e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-b16cf6be-8167-4c31-b8a9-a753e6526f4e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-b16cf6be-8167-4c31-b8a9-a753e6526f4e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-b16cf6be-8167-4c31-b8a9-a753e6526f4e" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc64d1a-1b8c-4f65-a42b-d48902e810b1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:45 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e Aug 19 00:18:45 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:45 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e" returned: 0 in 0.470s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:45 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e Aug 19 00:18:45 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:46 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b16cf6be-8167-4c31-b8a9-a753e6526f4e" returned: 0 in 0.339s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-b16cf6be-8167-4c31-b8a9-a753e6526f4e" released by "delete_volume" :: held 0.870s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['8d2f6540-4fe5-42a2-88ed-fe06560ad3b6', '405dbefd-e152-406b-b311-82b2daf156d9', '35c34023-bc6b-4a1b-8545-90690661fdd6', 'b9eb7351-b974-4854-8474-22fa40731f75'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Acquiring lock "cinder-2cbca03f-3b86-4043-bb64-72dd62b8f7fe-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Lock "cinder-2cbca03f-3b86-4043-bb64-72dd62b8f7fe-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:46 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:46 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Acquiring lock "cinder-quobyte-2cbca03f-3b86-4043-bb64-72dd62b8f7fe" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Lock "cinder-quobyte-2cbca03f-3b86-4043-bb64-72dd62b8f7fe" acquired by "delete_volume" :: waited 0.042s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-2ef52252-af1b-41b3-8900-b65634e0c7bf" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ea416-1eac-49f9-b0a4-ca411f54e13c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2ef52252-af1b-41b3-8900-b65634e0c7bf" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Deleting offline snapshot a68ca5d4-e804-4bbb-9a75-ad5e275fa51b of volume 2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] snapshot_file for this snap is: volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184b0fd-4249-4bc5-8d95-a2553e57dfde]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:46 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe Aug 19 00:18:46 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:46 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Deleted volume successfully. Aug 19 00:18:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fbd9d0b7-4027-4011-bc80-89b4f4b48c3c tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-b16cf6be-8167-4c31-b8a9-a753e6526f4e-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:46 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b Aug 19 00:18:46 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:47 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe" returned: 0 in 0.609s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:47 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe Aug 19 00:18:47 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:47 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" returned: 0 in 0.637s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef52252-af1b-41b3-8900-b65634e0c7bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ec30b-19fe-4941-a628-2642179e5064]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:47 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cbca03f-3b86-4043-bb64-72dd62b8f7fe" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:47 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf Aug 19 00:18:47 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Lock "cinder-quobyte-2cbca03f-3b86-4043-bb64-72dd62b8f7fe" released by "delete_volume" :: held 1.017s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Created reservations ['bff40ab7-72ce-449c-8dae-baa940e20252', '5cae0de9-8e90-4fa4-a408-e47c1f72a87e', 'd6e0e551-a7e0-4183-b2cd-22af0b0bd41c', '8117be7d-772d-411b-8c80-588fcd7e8dd2'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:47 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:47 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:48 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.383s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:48 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf" returned: 0 in 0.747s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Deleted volume successfully. Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-41b167cf-3416-47dd-b4f4-e76e01abf584 tempest-VolumesActionsTest-445362628 None] Lock "cinder-2cbca03f-3b86-4043-bb64-72dd62b8f7fe-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:48 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b Aug 19 00:18:48 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:48 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" returned: 0 in 0.462s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:48 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b Aug 19 00:18:48 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:48 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf.a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" returned: 0 in 0.304s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b" released by "_delete_snapshot" :: held 2.313s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2ef52252-af1b-41b3-8900-b65634e0c7bf" released by "delete_snapshot" :: held 2.366s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:48 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['1e72b37d-234d-4644-bf78-0d6589aee6e5', '9dfde4fc-9c7f-481b-b0d0-c8598bf9a4fa', '6979e02e-dccf-458a-86fb-39d1ac2338fd', '134feb34-8f56-424d-928c-bd62580b5798'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Delete snapshot completed successfully. Aug 19 00:18:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b8fc5489-5eb0-4893-9335-0e3c8427be71 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-a68ca5d4-e804-4bbb-9a75-ad5e275fa51b-delete_snapshot" released by "delete_snapshot" :: held 2.647s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-2ef52252-af1b-41b3-8900-b65634e0c7bf-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-2ef52252-af1b-41b3-8900-b65634e0c7bf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-2ef52252-af1b-41b3-8900-b65634e0c7bf" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2ef52252-af1b-41b3-8900-b65634e0c7bf" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3102fff-a605-4a8d-9d60-8ee554d85aa0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:50 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf Aug 19 00:18:50 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:50 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf" returned: 0 in 0.525s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:50 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf Aug 19 00:18:50 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:50 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ef52252-af1b-41b3-8900-b65634e0c7bf" returned: 0 in 0.316s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2ef52252-af1b-41b3-8900-b65634e0c7bf" released by "delete_volume" :: held 0.963s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['0b37aefd-c98a-4f31-b38d-617190049c54', '3db0fee3-07d4-4880-a692-bfd465991ae8', 'e13b0e3e-a013-4074-9460-c1ad1eed7125', 'a7d5f2ad-bcc3-404f-83ac-0bd8301b88ab'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:51 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:51 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:51 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.450s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Deleted volume successfully. Aug 19 00:18:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d2b1ac6d-844d-4145-b43e-5623a9e80c79 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-2ef52252-af1b-41b3-8900-b65634e0c7bf-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-2cfce1af-3934-409f-bbf1-35b3e1a30164-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-2cfce1af-3934-409f-bbf1-35b3e1a30164-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "cinder-quobyte-2cfce1af-3934-409f-bbf1-35b3e1a30164" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:18:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2cfce1af-3934-409f-bbf1-35b3e1a30164" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:18:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcb9d9d-9267-4290-a4c6-bb77372806f3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:18:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:52 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 Aug 19 00:18:52 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:53 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164" returned: 0 in 0.522s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:53 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164 Aug 19 00:18:53 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3aea5b60-87a0-4233-a5ba-ff981584dce6 tempest-GroupsV320Test-1207032592 None] Group tempest-GroupsV320Test-Group-397697903: creating Aug 19 00:18:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3aea5b60-87a0-4233-a5ba-ff981584dce6 tempest-GroupsV320Test-1207032592 None] Group tempest-GroupsV320Test-Group-397697903: created successfully Aug 19 00:18:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3aea5b60-87a0-4233-a5ba-ff981584dce6 tempest-GroupsV320Test-1207032592 None] Create group completed successfully. Aug 19 00:18:53 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2cfce1af-3934-409f-bbf1-35b3e1a30164" returned: 0 in 0.271s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-quobyte-2cfce1af-3934-409f-bbf1-35b3e1a30164" released by "delete_volume" :: held 0.877s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Created reservations ['7be8e15f-ed9f-4ff1-b913-ad0f580144ad', '469321ec-9902-41e3-9e75-d38fdcf1109c', '77fda058-cb7b-4202-93e3-edee3a7b2a19', '631fce77-98f6-4c52-8ea8-f7742b3bbfc7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:53 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:53 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:53 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.256s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Deleted volume successfully. Aug 19 00:18:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-21d35e8d-59f3-4299-a631-c4db37895e90 tempest-VolumesSnapshotTestJSON-948643194 None] Lock "cinder-2cfce1af-3934-409f-bbf1-35b3e1a30164-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Created reservations ['b522e8e9-4010-4888-8a9c-73ea18c83028'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:18:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:18:54 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:18:54 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:18:55 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Aug 19 00:18:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.302s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:18:55 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:18:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e5279d2d-dd8b-4b09-a4e3-544b56ab9160 tempest-GroupsV320Test-1207032592 None] Delete group completed successfully. Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Flow 'volume_create_manager' (186b1a22-8634-49fa-bd87-ab93eb468f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc99d73-0603-41e7-9971-2bb9d2ff95d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc99d73-0603-41e7-9971-2bb9d2ff95d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1722178367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075309ac-6271-4a1f-9f62-6864aa6d25a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0143a5d37f0046cb9ee0337062123725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:02Z,use_quota=True,user_id='17e1d26637ce415a8ab6bf99a9c3096b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9dcd4d-c5fd-4efb-997f-14d05b19db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9dcd4d-c5fd-4efb-997f-14d05b19db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e09764a-c082-4b6c-aa7f-9702f0adb316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e09764a-c082-4b6c-aa7f-9702f0adb316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075309ac-6271-4a1f-9f62-6864aa6d25a7', 'volume_name': 'volume-075309ac-6271-4a1f-9f62-6864aa6d25a7', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639fe73e-9609-4e86-bcc5-fbec65b0812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639fe73e-9609-4e86-bcc5-fbec65b0812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26806196-d6d4-4bd6-9d16-3020d14108ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Volume 075309ac-6271-4a1f-9f62-6864aa6d25a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075309ac-6271-4a1f-9f62-6864aa6d25a7', 'volume_size': 1} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1722178367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075309ac-6271-4a1f-9f62-6864aa6d25a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0143a5d37f0046cb9ee0337062123725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:02Z,use_quota=True,user_id='17e1d26637ce415a8ab6bf99a9c3096b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Creating volume 075309ac-6271-4a1f-9f62-6864aa6d25a7 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:02 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:02 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 1073741824 Aug 19 00:19:02 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Flow 'volume_create_manager' (a0c815d6-ca91-40ab-9f4e-693b905de367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fbde3c-0f4e-4850-bc8a-aef2554d4083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fbde3c-0f4e-4850-bc8a-aef2554d4083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-820520064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82229a04-9806-4efd-8939-ae210712d02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0143a5d37f0046cb9ee0337062123725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:03Z,use_quota=True,user_id='17e1d26637ce415a8ab6bf99a9c3096b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06d0915-31e8-47d2-80cc-4df59bdc1933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06d0915-31e8-47d2-80cc-4df59bdc1933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab3f900-bacd-44e6-b2e1-2fd6dc663932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab3f900-bacd-44e6-b2e1-2fd6dc663932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82229a04-9806-4efd-8939-ae210712d02f', 'volume_name': 'volume-82229a04-9806-4efd-8939-ae210712d02f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f7e331-19f9-424d-9cae-e313a3a2bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f7e331-19f9-424d-9cae-e313a3a2bae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb50870d-f6eb-4865-9e5f-29ae53c522f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Volume 82229a04-9806-4efd-8939-ae210712d02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82229a04-9806-4efd-8939-ae210712d02f', 'volume_size': 1} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:02 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 1073741824" returned: 0 in 0.671s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:02 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 Aug 19 00:19:02 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:03 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7" returned: 0 in 0.427s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-820520064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82229a04-9806-4efd-8939-ae210712d02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0143a5d37f0046cb9ee0337062123725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:03Z,use_quota=True,user_id='17e1d26637ce415a8ab6bf99a9c3096b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Creating volume 82229a04-9806-4efd-8939-ae210712d02f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:03 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26806196-d6d4-4bd6-9d16-3020d14108ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075309ac-6271-4a1f-9f62-6864aa6d25a7', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:03 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f 1073741824 Aug 19 00:19:03 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459b6295-a177-4827-9bf5-4e3113415fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:03 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Volume volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 (075309ac-6271-4a1f-9f62-6864aa6d25a7): created successfully Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459b6295-a177-4827-9bf5-4e3113415fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Flow 'volume_create_manager' (186b1a22-8634-49fa-bd87-ab93eb468f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:03 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-aaa0e77d-97b1-4513-b002-d40b5c4a4da4 tempest-TestServerVolumeAttachmentScenario-939137365 None] Created volume successfully. Aug 19 00:19:03 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f 1073741824" returned: 0 in 0.598s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:04 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f Aug 19 00:19:04 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:04 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f" returned: 0 in 0.403s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=221,cinder:SELECT=158,cinder:DELETE=17,cinder:INSERT=50 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb50870d-f6eb-4865-9e5f-29ae53c522f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82229a04-9806-4efd-8939-ae210712d02f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25d898f-d6e7-400d-9687-dd2356b3cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=194,cinder:UPDATE=195,cinder:INSERT=52,cinder:DELETE=8 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:19:04 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Volume volume-82229a04-9806-4efd-8939-ae210712d02f (82229a04-9806-4efd-8939-ae210712d02f): created successfully Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25d898f-d6e7-400d-9687-dd2356b3cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Flow 'volume_create_manager' (a0c815d6-ca91-40ab-9f4e-693b905de367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4e01b392-4558-498f-82d6-21c6770cba70 tempest-TestServerVolumeAttachmentScenario-939137365 None] Created volume successfully. Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Flow 'volume_create_manager' (04a04506-1e7a-4668-b29b-900155801c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a37b412-42ee-4d98-890b-8e0dd146eb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a37b412-42ee-4d98-890b-8e0dd146eb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-594189677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb523eba-17e7-4bd6-9e2b-d2e65835d7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a12b92b3610485ca29a14d17689c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:07Z,use_quota=True,user_id='3870da80411940419efa18b5c5845b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b36ceb-afe5-41cc-85f5-3345db3ddba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b36ceb-afe5-41cc-85f5-3345db3ddba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb927ff-7b8d-4bb5-b1d4-9f6415632b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb927ff-7b8d-4bb5-b1d4-9f6415632b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb523eba-17e7-4bd6-9e2b-d2e65835d7bb', 'volume_name': 'volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb', 'volume_size': 2}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38aca86b-df9c-4b50-8416-573224356997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38aca86b-df9c-4b50-8416-573224356997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11424ba8-928e-4060-acfa-9ff95d72c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:07 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Volume eb523eba-17e7-4bd6-9e2b-d2e65835d7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb', 'volume_size': 2} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-594189677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb523eba-17e7-4bd6-9e2b-d2e65835d7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a12b92b3610485ca29a14d17689c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:07Z,use_quota=True,user_id='3870da80411940419efa18b5c5845b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Creating volume eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:07 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb 2147483648 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:07 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb 2147483648 Aug 19 00:19:07 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:08 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb 2147483648" returned: 0 in 0.620s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:08 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb Aug 19 00:19:08 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:08 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11424ba8-928e-4060-acfa-9ff95d72c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb', 'volume_size': 2}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc00513-1bed-4dfa-acc7-4dbfa44a2d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:08 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Volume volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb (eb523eba-17e7-4bd6-9e2b-d2e65835d7bb): created successfully Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc00513-1bed-4dfa-acc7-4dbfa44a2d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:08 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Flow 'volume_create_manager' (04a04506-1e7a-4668-b29b-900155801c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c9f99412-2101-4748-acf6-3e31cc9d1e2f tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Created volume successfully. Aug 19 00:19:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Creating offline snapshot 67193ea4-3d21-4fd8-a5a2-f0875086338a of volume eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:19:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20a83a-c901-46e5-a19d-9b9e94ba1ec1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:10 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb Aug 19 00:19:10 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:10 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" returned: 0 in 0.523s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a 2G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:10 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a 2G Aug 19 00:19:10 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:10 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a 2G" returned: 0 in 0.554s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:10 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a Aug 19 00:19:10 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:11 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a" returned: 0 in 0.394s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:11 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a is being set with open permissions: ugo+rw Aug 19 00:19:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:11 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a Aug 19 00:19:11 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:11 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a" returned: 0 in 0.417s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:11 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info Aug 19 00:19:11 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:12 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:12 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info is being set with open permissions: ugo+rw Aug 19 00:19:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:12 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info Aug 19 00:19:12 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:12 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.info" returned: 0 in 0.496s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b288fe7a-2cd9-4003-997a-0e5e68968a62 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Create snapshot completed successfully Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "cinder-67193ea4-3d21-4fd8-a5a2-f0875086338a-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:13 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:13 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-67193ea4-3d21-4fd8-a5a2-f0875086338a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "cinder-quobyte-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-quobyte-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" acquired by "delete_snapshot" :: waited 0.054s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "cinder-quobyte-67193ea4-3d21-4fd8-a5a2-f0875086338a" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-quobyte-67193ea4-3d21-4fd8-a5a2-f0875086338a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Deleting offline snapshot 67193ea4-3d21-4fd8-a5a2-f0875086338a of volume eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] snapshot_file for this snap is: volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aca3b5-ebe3-4eb7-9af7-6f5dd15067c8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:13 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a Aug 19 00:19:13 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:14 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.773s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:19:14 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a" returned: 0 in 0.773s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e0c9e8-2770-4eeb-ab4f-d0a293143810]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:14 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb Aug 19 00:19:14 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:14 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" returned: 0 in 0.494s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:15 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a Aug 19 00:19:15 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:15 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a" returned: 0 in 0.503s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:15 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a Aug 19 00:19:15 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:15 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb.67193ea4-3d21-4fd8-a5a2-f0875086338a" returned: 0 in 0.320s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-quobyte-67193ea4-3d21-4fd8-a5a2-f0875086338a" released by "_delete_snapshot" :: held 2.293s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-quobyte-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" released by "delete_snapshot" :: held 2.352s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Flow 'volume_create_manager' (9fe1293f-d93a-4566-acac-53ffa4cd2b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0501e3ab-c52c-4d63-afd7-adc9f32484dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0501e3ab-c52c-4d63-afd7-adc9f32484dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1182603893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677dd99e-bcbd-45c3-ab17-91bfaac4f3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067b474b8339483baddf8b02d954d520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:16Z,use_quota=True,user_id='7369bfa15b304217b85b205e182241c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75ee875-0f6f-4f98-93ff-47d0b8f488d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75ee875-0f6f-4f98-93ff-47d0b8f488d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d812580-318e-4bd6-8d9c-1959801c57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d812580-318e-4bd6-8d9c-1959801c57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677dd99e-bcbd-45c3-ab17-91bfaac4f3bb', 'volume_name': 'volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6963d1d5-1ad6-41fb-9d56-488c7d31974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6963d1d5-1ad6-41fb-9d56-488c7d31974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73136fbf-3cd6-4699-96ab-40fa4d1c8cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:16 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Volume 677dd99e-bcbd-45c3-ab17-91bfaac4f3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb', 'volume_size': 1} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1182603893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677dd99e-bcbd-45c3-ab17-91bfaac4f3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067b474b8339483baddf8b02d954d520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:16Z,use_quota=True,user_id='7369bfa15b304217b85b205e182241c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Creating volume 677dd99e-bcbd-45c3-ab17-91bfaac4f3bb {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:16 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Created reservations ['9b54192f-65e3-432c-8b1d-71c26049d850', 'd70cbb60-d94f-4808-80ee-e7287045b412', '55ea1f8e-e818-4ab0-9776-3effb31687ff', '8d7692d8-9f86-4635-82bb-75a5ec0b40cf'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:16 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb 1073741824 Aug 19 00:19:16 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Delete snapshot completed successfully. Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b2ec2ef8-213b-4d2a-a41c-0b2a9e25df57 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-67193ea4-3d21-4fd8-a5a2-f0875086338a-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:16 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb 1073741824" returned: 0 in 0.665s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:16 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb Aug 19 00:19:16 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "cinder-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "cinder-quobyte-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-quobyte-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e2450-62ad-49c0-8f9e-17cc27a80234]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:17 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb" returned: 0 in 0.404s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73136fbf-3cd6-4699-96ab-40fa4d1c8cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e1a1a8-7c05-4b93-859d-16de801d2a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Volume volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb (677dd99e-bcbd-45c3-ab17-91bfaac4f3bb): created successfully Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e1a1a8-7c05-4b93-859d-16de801d2a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Flow 'volume_create_manager' (9fe1293f-d93a-4566-acac-53ffa4cd2b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-08827033-ae73-4377-aaf4-6ac4d164ee6d tempest-VolumesMetadataTest-445531751 None] Created volume successfully. Aug 19 00:19:17 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb Aug 19 00:19:17 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:17 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" returned: 0 in 0.495s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:17 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb Aug 19 00:19:17 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:18 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" returned: 0 in 0.558s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-quobyte-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb" released by "delete_volume" :: held 1.176s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Created reservations ['07c284d9-1128-4a13-b516-8d81f99fe522', 'cfa1cd14-7f4b-4671-a226-b7a528f42a20', '0b5cf1f8-c936-4de6-9279-209a929d325c', 'a85e1d54-1d64-4973-8c51-59b003f74f79'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:18 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:18 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:18 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.536s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:18 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Deleted volume successfully. Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4576f4a3-8c52-49c8-ae27-9acc55c87488 tempest-VolumesSnapshotNegativeTestJSON-61515435 None] Lock "cinder-eb523eba-17e7-4bd6-9e2b-d2e65835d7bb-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Acquiring lock "cinder-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Lock "cinder-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Acquiring lock "cinder-quobyte-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Lock "cinder-quobyte-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb" acquired by "delete_volume" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[639416dc-0c99-4639-898a-cd21156a77f4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:19 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb Aug 19 00:19:19 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:20 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb" returned: 0 in 0.472s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:20 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb Aug 19 00:19:20 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:20 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Lock "cinder-quobyte-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb" released by "delete_volume" :: held 0.865s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Created reservations ['b1c48e3f-02fd-4d1b-bd00-3b06ba1c014d', '1e4cac18-1ec8-4842-b9db-7de2c1295c1a', 'f6dce1fc-8301-46ce-a7c2-71f7153c389f', 'b65a5670-5bd0-4862-8ad8-d4f4bd2596d1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:20 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:20 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:20 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.376s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:20 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Deleted volume successfully. Aug 19 00:19:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d1c8c4a9-1e54-4102-b77b-bfe1130e0feb tempest-VolumesMetadataTest-445531751 None] Lock "cinder-677dd99e-bcbd-45c3-ab17-91bfaac4f3bb-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Flow 'volume_create_manager' (1b332b59-d189-462f-aef9-9b1e7b5247d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00372daf-f042-415c-b1c5-6e37b50a3001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Flow 'volume_create_manager' (3830dcd3-4b1c-4901-a36a-fea8b60929df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead0706f-12a4-44d3-b1b7-29618494d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00372daf-f042-415c-b1c5-6e37b50a3001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-7875444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e747b68-a98c-4f1c-86f0-b8555c0f545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d62d7d29cc745fb8db4ce7fc17939e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:26Z,use_quota=True,user_id='632338cddb3a41d5942d38e4ac201051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c00abe46-c382-4ac7-91b2-259ac5aaa916),volume_type_id=c00abe46-c382-4ac7-91b2-259ac5aaa916)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6ba1c2-aa9d-490e-83ba-64e07da61a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6ba1c2-aa9d-490e-83ba-64e07da61a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d078f08b-d329-4cca-9a13-80795b79be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d078f08b-d329-4cca-9a13-80795b79be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e747b68-a98c-4f1c-86f0-b8555c0f545b', 'volume_name': 'volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f23a5-44b3-4fd7-9454-2e0fbf4a5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f23a5-44b3-4fd7-9454-2e0fbf4a5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d773d451-0485-4438-b375-b5a754941bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Volume 4e747b68-a98c-4f1c-86f0-b8555c0f545b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b', 'volume_size': 1} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-7875444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e747b68-a98c-4f1c-86f0-b8555c0f545b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d62d7d29cc745fb8db4ce7fc17939e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:26Z,use_quota=True,user_id='632338cddb3a41d5942d38e4ac201051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c00abe46-c382-4ac7-91b2-259ac5aaa916),volume_type_id=c00abe46-c382-4ac7-91b2-259ac5aaa916)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Creating volume 4e747b68-a98c-4f1c-86f0-b8555c0f545b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:25 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead0706f-12a4-44d3-b1b7-29618494d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1922366399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15dd936-2a64-4ae9-bc9d-877329281feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8292fcf60d4cb79c9a3d65ecad30c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:26Z,use_quota=True,user_id='99c6c41328ce4c758dcaa072e397a709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b 1073741824 Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676dff71-82d9-4271-9f47-a5bba7880b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676dff71-82d9-4271-9f47-a5bba7880b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c77b25a-ff60-4aee-b5ca-8a8f559a64da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c77b25a-ff60-4aee-b5ca-8a8f559a64da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15dd936-2a64-4ae9-bc9d-877329281feb', 'volume_name': 'volume-b15dd936-2a64-4ae9-bc9d-877329281feb', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482a1dc7-7512-4c9a-81ba-8a6375d4ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482a1dc7-7512-4c9a-81ba-8a6375d4ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af81082-f49d-4bd8-9c43-e98f8d9f6a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Volume b15dd936-2a64-4ae9-bc9d-877329281feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15dd936-2a64-4ae9-bc9d-877329281feb', 'volume_size': 1} Aug 19 00:19:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:26 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b 1073741824" returned: 0 in 0.523s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:26 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b Aug 19 00:19:26 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:26 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b" returned: 0 in 0.273s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1922366399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15dd936-2a64-4ae9-bc9d-877329281feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8292fcf60d4cb79c9a3d65ecad30c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:26Z,use_quota=True,user_id='99c6c41328ce4c758dcaa072e397a709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Creating volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:26 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:26 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb 1073741824 Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d773d451-0485-4438-b375-b5a754941bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:26 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ec5a2-b9ee-4df0-862a-897fbf07bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Volume volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b (4e747b68-a98c-4f1c-86f0-b8555c0f545b): created successfully Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ec5a2-b9ee-4df0-862a-897fbf07bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Flow 'volume_create_manager' (1b332b59-d189-462f-aef9-9b1e7b5247d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2a45c5b0-8bca-4491-8bfa-e55c12688a1a tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Created volume successfully. Aug 19 00:19:27 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb 1073741824" returned: 0 in 0.514s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:27 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb Aug 19 00:19:27 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:27 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb" returned: 0 in 0.339s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af81082-f49d-4bd8-9c43-e98f8d9f6a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15dd936-2a64-4ae9-bc9d-877329281feb', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3f3e38-a2f2-45b4-99d3-69e4547a49a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Volume volume-b15dd936-2a64-4ae9-bc9d-877329281feb (b15dd936-2a64-4ae9-bc9d-877329281feb): created successfully Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3f3e38-a2f2-45b4-99d3-69e4547a49a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Flow 'volume_create_manager' (3830dcd3-4b1c-4901-a36a-fea8b60929df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a1c126aa-5cf9-4458-9a02-0a1173b31968 tempest-VolumesSnapshotListTestJSON-742251810 None] Created volume successfully. Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:27 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:27 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:28 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.302s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-593f586e-3e95-4a48-9129-051363a1a114 tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Retype volume completed successfully. Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Creating offline snapshot a18f4272-3d8c-4773-89f6-fea9fbf56338 of volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94325204-dfd2-47f8-8e15-4dbc75a96916]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:28 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb Aug 19 00:19:28 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Acquiring lock "cinder-4e747b68-a98c-4f1c-86f0-b8555c0f545b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "cinder-4e747b68-a98c-4f1c-86f0-b8555c0f545b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Acquiring lock "cinder-quobyte-4e747b68-a98c-4f1c-86f0-b8555c0f545b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "cinder-quobyte-4e747b68-a98c-4f1c-86f0-b8555c0f545b" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[59656fe0-d310-49e3-945f-00c1efc81f20]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:29 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb" returned: 0 in 0.516s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:29 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 1G Aug 19 00:19:29 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:29 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b Aug 19 00:19:29 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:29 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b" returned: 0 in 0.544s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:29 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b Aug 19 00:19:29 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:29 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 1G" returned: 0 in 0.530s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:29 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:29 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:30 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-4e747b68-a98c-4f1c-86f0-b8555c0f545b" returned: 0 in 0.322s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "cinder-quobyte-4e747b68-a98c-4f1c-86f0-b8555c0f545b" released by "delete_volume" :: held 0.941s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:30 devstack cinder-volume[94243]: WARNING cinder.quota [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:19:30 devstack cinder-volume[94243]: WARNING cinder.quota [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Created reservations ['32d032a2-fe14-436b-a618-76c56a18a48a', '97ae8e96-7ad9-4781-b7f1-12faf0eb487e', '78aaec65-a58d-44a6-bc8a-0a6c63fab313', '26a96d0e-96a7-4254-863c-a9a1f8843c2e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:30 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.391s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:30 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 is being set with open permissions: ugo+rw Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:30 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:30 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:30 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:30 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:30 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.316s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:30 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.304s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Deleted volume successfully. Aug 19 00:19:30 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info Aug 19 00:19:30 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-02f0a8fa-6cce-40a8-bc70-fcd8d85a78ba tempest-VolumeRetypeWithoutMigrationTest-471253066 None] Lock "cinder-4e747b68-a98c-4f1c-86f0-b8555c0f545b-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:30 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:30 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info is being set with open permissions: ugo+rw Aug 19 00:19:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:30 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info Aug 19 00:19:30 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:31 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.info" returned: 0 in 0.296s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d12a6c7e-b7dc-4ec1-a96a-766a1141e6aa tempest-VolumesSnapshotListTestJSON-742251810 None] Create snapshot completed successfully Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Creating offline snapshot e9a8568f-e74a-4d76-b225-03b7ad81b9d5 of volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea3533-d91c-4073-ae9e-35f1a986b48d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:32 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:32 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:32 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:32 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 1G Aug 19 00:19:32 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:33 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 1G" returned: 0 in 0.467s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:33 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:33 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:33 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.355s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:33 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 is being set with open permissions: ugo+rw Aug 19 00:19:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:33 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:33 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:33 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.309s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ae7e70d5-a1d8-4a61-8b8a-d349fc514877 tempest-VolumesSnapshotListTestJSON-742251810 None] Create snapshot completed successfully Aug 19 00:19:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Creating offline snapshot 3a7d13a3-adf7-49b7-b943-38f13c6db624 of volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:19:34 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca58b6f8-e6ab-4483-9c67-f4ad1d4cead3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:34 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:34 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:35 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.606s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:35 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 1G Aug 19 00:19:35 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:35 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 1G" returned: 0 in 0.648s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:35 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 Aug 19 00:19:35 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:36 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:36 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 is being set with open permissions: ugo+rw Aug 19 00:19:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:36 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 Aug 19 00:19:36 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:36 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624" returned: 0 in 0.287s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ff398c96-9133-49ba-959a-fab38286a431 tempest-VolumesSnapshotListTestJSON-742251810 None] Create snapshot completed successfully Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-3a7d13a3-adf7-49b7-b943-38f13c6db624-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-3a7d13a3-adf7-49b7-b943-38f13c6db624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-3a7d13a3-adf7-49b7-b943-38f13c6db624" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-3a7d13a3-adf7-49b7-b943-38f13c6db624" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Deleting offline snapshot 3a7d13a3-adf7-49b7-b943-38f13c6db624 of volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] snapshot_file for this snap is: volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[55174667-200f-47b4-812e-f4f73f55d1c4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:39 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 Aug 19 00:19:39 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:39 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624" returned: 0 in 0.619s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e248e2e-5ac9-4ad5-a55e-8f02a5006a93]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:39 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:39 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-78a4f363-7512-4997-9e38-ba2e5fec0c0f req-11bc42bd-fbcc-4c14-b0f1-f02b59c0b924 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-78a4f363-7512-4997-9e38-ba2e5fec0c0f req-11bc42bd-fbcc-4c14-b0f1-f02b59c0b924 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-78a4f363-7512-4997-9e38-ba2e5fec0c0f req-11bc42bd-fbcc-4c14-b0f1-f02b59c0b924 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-78a4f363-7512-4997-9e38-ba2e5fec0c0f req-11bc42bd-fbcc-4c14-b0f1-f02b59c0b924 tempest-TestServerVolumeAttachmentScenario-939137365 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-075309ac-6271-4a1f-9f62-6864aa6d25a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '310e7ca3-15ab-4662-bca2-70226f3e6378', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:19:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-78a4f363-7512-4997-9e38-ba2e5fec0c0f req-11bc42bd-fbcc-4c14-b0f1-f02b59c0b924 tempest-TestServerVolumeAttachmentScenario-939137365 None] attachment_update completed successfully. Aug 19 00:19:40 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.537s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:40 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 Aug 19 00:19:40 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:40 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624" returned: 0 in 0.629s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:40 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624 Aug 19 00:19:40 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:41 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.3a7d13a3-adf7-49b7-b943-38f13c6db624" returned: 0 in 0.483s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-3a7d13a3-adf7-49b7-b943-38f13c6db624" released by "_delete_snapshot" :: held 2.420s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" released by "delete_snapshot" :: held 2.455s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Created reservations ['c8543a75-d4b8-42e3-88f4-df5034b0d85d', '11d5a4cb-c125-4f43-9cf8-9d47edeaac8a', '449b2ba0-7f7f-48f7-b6fc-c44db7212754', 'ab39f8aa-1b7f-43d9-8c14-e91ea4bdf4f6'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Delete snapshot completed successfully. Aug 19 00:19:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7191af21-b081-40c5-bba9-a22de55356fc tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-3a7d13a3-adf7-49b7-b943-38f13c6db624-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-e9a8568f-e74a-4d76-b225-03b7ad81b9d5-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-e9a8568f-e74a-4d76-b225-03b7ad81b9d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-e9a8568f-e74a-4d76-b225-03b7ad81b9d5" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-e9a8568f-e74a-4d76-b225-03b7ad81b9d5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Deleting offline snapshot e9a8568f-e74a-4d76-b225-03b7ad81b9d5 of volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] snapshot_file for this snap is: volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b093ab-b1e9-467c-96b6-10431cc33c9b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:42 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:42 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:42 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.598s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a48982-cd7b-4fef-8b35-41faa2a14070]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:43 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:43 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.617s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:43 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:43 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:43 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:44 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.676s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:44 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5 Aug 19 00:19:44 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:44 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.e9a8568f-e74a-4d76-b225-03b7ad81b9d5" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-e9a8568f-e74a-4d76-b225-03b7ad81b9d5" released by "_delete_snapshot" :: held 2.382s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" released by "delete_snapshot" :: held 2.424s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Created reservations ['e638900f-3589-4476-a5f2-212d5ed2053f', 'eba90662-4433-4f8c-9a24-ec6498c2a106', '0c14565c-5712-460e-b0ef-27a957dbd0fb', '13037b81-7637-45b6-a381-e9bcc63459a8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Delete snapshot completed successfully. Aug 19 00:19:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5755db1d-d0a3-44a4-a93e-9e0c74c9af81 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-e9a8568f-e74a-4d76-b225-03b7ad81b9d5-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Flow 'volume_create_manager' (223de395-ddc5-41b4-8d43-6ae9fa8f22f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248c70b2-42a5-42c8-b2ae-28690c0fa5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248c70b2-42a5-42c8-b2ae-28690c0fa5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2061378056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9667cb-2297-447b-b495-ebc5c397dfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a54db4da7f04926a62637a9ae64bf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:45Z,use_quota=True,user_id='95d2d452b14f4d7a911b9bacbe5a6f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7550bf-8be2-4fff-a428-aa01cf951e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7550bf-8be2-4fff-a428-aa01cf951e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13273f2d-c457-47ad-90b3-bfc0a9c3e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13273f2d-c457-47ad-90b3-bfc0a9c3e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae9667cb-2297-447b-b495-ebc5c397dfd9', 'volume_name': 'volume-ae9667cb-2297-447b-b495-ebc5c397dfd9', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb60253-7b93-4f9c-838b-009710527889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb60253-7b93-4f9c-838b-009710527889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87180e8-a77f-48e0-99cd-232babd1fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:45 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Volume ae9667cb-2297-447b-b495-ebc5c397dfd9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae9667cb-2297-447b-b495-ebc5c397dfd9', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Trying to clone ae9667cb-2297-447b-b495-ebc5c397dfd9 from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-a18f4272-3d8c-4773-89f6-fea9fbf56338-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-a18f4272-3d8c-4773-89f6-fea9fbf56338-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-a18f4272-3d8c-4773-89f6-fea9fbf56338" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-a18f4272-3d8c-4773-89f6-fea9fbf56338" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Deleting offline snapshot a18f4272-3d8c-4773-89f6-fea9fbf56338 of volume b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] snapshot_file for this snap is: volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:19:45 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:19:46 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Image download 20.69 MB at 20.69 MB/s Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d97e83-dbed-440a-b5ad-49f4eb183513]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc6dba2-0652-498e-97b9-acd7b89aed5d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:46 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:46 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:46 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD Aug 19 00:19:46 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:46 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.532s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b15dd936-2a64-4ae9-bc9d-877329281feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[08690379-d952-4120-90ce-796114394793]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:46 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 is fetched for user 95d2d452b14f4d7a911b9bacbe5a6f61. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c5ba2-6115-4d4b-97f7-2bd9c9f67e05]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-219f0a82-1e35-4e5b-9998-648c7cf7aff2 req-e16fb019-2c2b-406c-a79f-309699071255 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:46 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb Aug 19 00:19:46 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-219f0a82-1e35-4e5b-9998-648c7cf7aff2 req-e16fb019-2c2b-406c-a79f-309699071255 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-219f0a82-1e35-4e5b-9998-648c7cf7aff2 req-e16fb019-2c2b-406c-a79f-309699071255 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-219f0a82-1e35-4e5b-9998-648c7cf7aff2 req-e16fb019-2c2b-406c-a79f-309699071255 tempest-TestServerVolumeAttachmentScenario-939137365 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-82229a04-9806-4efd-8939-ae210712d02f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53622655-a65d-43f3-8a61-6e477cc60e0e', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:19:46 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD Aug 19 00:19:46 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-219f0a82-1e35-4e5b-9998-648c7cf7aff2 req-e16fb019-2c2b-406c-a79f-309699071255 tempest-TestServerVolumeAttachmentScenario-939137365 None] attachment_update completed successfully. Aug 19 00:19:47 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb" returned: 0 in 0.504s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:47 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:47 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:47 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2061378056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae9667cb-2297-447b-b495-ebc5c397dfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a54db4da7f04926a62637a9ae64bf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:19:45Z,use_quota=True,user_id='95d2d452b14f4d7a911b9bacbe5a6f61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Creating volume ae9667cb-2297-447b-b495-ebc5c397dfd9 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:19:47 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:47 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 1073741824 Aug 19 00:19:47 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:47 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.493s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:47 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338 Aug 19 00:19:47 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:47 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 1073741824" returned: 0 in 0.578s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:47 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb.a18f4272-3d8c-4773-89f6-fea9fbf56338" returned: 0 in 0.308s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:47 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 Aug 19 00:19:47 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-a18f4272-3d8c-4773-89f6-fea9fbf56338" released by "_delete_snapshot" :: held 1.998s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" released by "delete_snapshot" :: held 2.045s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Created reservations ['846215cf-2b73-403d-879d-d155a15938f1', '565f8b4d-e729-4dd6-8de4-43281e4da081', 'b19ce1d4-2460-4dc6-a955-0c3b6b32d59d', 'd27474d3-e81b-4704-8873-e23967ce4938'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Delete snapshot completed successfully. Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f375c4e0-9a43-4b73-8e61-b8b3fdb741a1 tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-a18f4272-3d8c-4773-89f6-fea9fbf56338-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:48 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9" returned: 0 in 0.314s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Attempting download of 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume ae9667cb-2297-447b-b495-ebc5c397dfd9. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c6047a-c4c1-4af2-98dc-fcc216755928]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:48 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i Aug 19 00:19:48 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:48 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i" returned: 0 in 0.349s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:48 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i Aug 19 00:19:48 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:48 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i" returned: 1 in 0.360s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43__d56of6i' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d4795b-a818-474f-af9b-e110992a7ba0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-b15dd936-2a64-4ae9-bc9d-877329281feb-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-b15dd936-2a64-4ae9-bc9d-877329281feb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:49 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD Aug 19 00:19:49 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4cfec-5a96-40ff-8ac0-2c866fe76bc3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:49 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb Aug 19 00:19:49 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:49 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] 71a9806a-90d3-4b78-b2e4-4f74e1036e43 was qcow2, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:49 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 Aug 19 00:19:49 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:49 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb" returned: 0 in 0.438s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:49 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb Aug 19 00:19:49 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-489e9693-b31f-407d-81b6-ca3c146a3cd3 req-79030d2e-d692-4057-b232-5df7cd42a2de tempest-TestServerVolumeAttachmentScenario-939137365 None] Terminate volume connection completed successfully. Aug 19 00:19:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-489e9693-b31f-407d-81b6-ca3c146a3cd3 req-79030d2e-d692-4057-b232-5df7cd42a2de tempest-TestServerVolumeAttachmentScenario-939137365 None] Deleting attachment 53622655-a65d-43f3-8a61-6e477cc60e0e. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:19:50 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b15dd936-2a64-4ae9-bc9d-877329281feb" returned: 0 in 0.352s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-quobyte-b15dd936-2a64-4ae9-bc9d-877329281feb" released by "delete_volume" :: held 0.881s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Created reservations ['68f4e4a6-bc87-4467-91c5-18841e298774', 'f6cc5741-a7c1-40c5-980b-6964fe75855e', '2d809703-ced6-4d22-a6d0-4715ccc2e6d4', 'cf8b84c4-922b-42c2-9315-3ab2e8ec3afe'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:50 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:50 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:50 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.342s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Deleted volume successfully. Aug 19 00:19:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0bcf6aa7-81e8-4a2a-b5e8-203479d9e9db tempest-VolumesSnapshotListTestJSON-742251810 None] Lock "cinder-b15dd936-2a64-4ae9-bc9d-877329281feb-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-374dd956-1aec-4bc1-9949-3317b4723b0a req-e4469e8a-3fdf-48ae-9999-966eab693b10 tempest-TestServerVolumeAttachmentScenario-939137365 None] Terminate volume connection completed successfully. Aug 19 00:19:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-374dd956-1aec-4bc1-9949-3317b4723b0a req-e4469e8a-3fdf-48ae-9999-966eab693b10 tempest-TestServerVolumeAttachmentScenario-939137365 None] Deleting attachment 310e7ca3-15ab-4662-bca2-70226f3e6378. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:19:52 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9" returned: 0 in 2.847s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_lumw_4f4devstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:19:52 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Converted 112.00 MB image at 39.33 MB/s Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:52 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 1G Aug 19 00:19:52 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:52 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 1G" returned: 0 in 0.617s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Downloaded image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume ae9667cb-2297-447b-b495-ebc5c397dfd9 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 for user 95d2d452b14f4d7a911b9bacbe5a6f61 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Marking volume ae9667cb-2297-447b-b495-ebc5c397dfd9 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Copying metadata from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 to ae9667cb-2297-447b-b495-ebc5c397dfd9. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:19:52 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Creating volume glance metadata for volume ae9667cb-2297-447b-b495-ebc5c397dfd9 backed by image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:19:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87180e8-a77f-48e0-99cd-232babd1fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9667cb-2297-447b-b495-ebc5c397dfd9', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd68b17-ce78-4bc0-9cc6-8a57b3b2e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:19:53 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Volume volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 (ae9667cb-2297-447b-b495-ebc5c397dfd9): created successfully Aug 19 00:19:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd68b17-ce78-4bc0-9cc6-8a57b3b2e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:19:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Flow 'volume_create_manager' (223de395-ddc5-41b4-8d43-6ae9fa8f22f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:19:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-53f43ff6-11b3-4b55-855b-04541e1799d7 tempest-VolumesImageMetadata-659635729 None] Created volume successfully. Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Acquiring lock "cinder-ae9667cb-2297-447b-b495-ebc5c397dfd9-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Lock "cinder-ae9667cb-2297-447b-b495-ebc5c397dfd9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Acquiring lock "cinder-quobyte-ae9667cb-2297-447b-b495-ebc5c397dfd9" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Lock "cinder-quobyte-ae9667cb-2297-447b-b495-ebc5c397dfd9" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ab89b3-385a-4c39-b041-be2644ab31fb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:54 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 Aug 19 00:19:54 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:54 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9" returned: 0 in 0.416s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:54 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9 Aug 19 00:19:54 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:55 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ae9667cb-2297-447b-b495-ebc5c397dfd9" returned: 0 in 0.285s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Lock "cinder-quobyte-ae9667cb-2297-447b-b495-ebc5c397dfd9" released by "delete_volume" :: held 0.766s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Created reservations ['7ea141a4-f76a-4520-bf85-020d17e28a28', '493fb452-7037-49e8-83ca-4ad160caa054', '858dbc9e-180f-4a87-8c22-66c4ec83b5b4', '29e827d0-b4d5-4bb3-930e-7ca2605421fb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:55 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:19:55 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:19:55 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.291s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:19:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Deleted volume successfully. Aug 19 00:19:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6257eedd-b92c-4bec-a35e-8b1a1a39a581 tempest-VolumesImageMetadata-659635729 None] Lock "cinder-ae9667cb-2297-447b-b495-ebc5c397dfd9-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:19:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "cinder-82229a04-9806-4efd-8939-ae210712d02f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-82229a04-9806-4efd-8939-ae210712d02f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "cinder-quobyte-82229a04-9806-4efd-8939-ae210712d02f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:19:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-quobyte-82229a04-9806-4efd-8939-ae210712d02f" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:19:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[89373a4c-7ef8-4249-b7af-272b6e1496f8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:19:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:19:59 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f Aug 19 00:19:59 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:00 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f" returned: 0 in 0.783s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:00 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f Aug 19 00:20:00 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Flow 'volume_create_manager' (3152510b-d052-4df1-ae69-34344a31dd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71a0889-ed21-47ec-a411-08a575a471b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a71a0889-ed21-47ec-a411-08a575a471b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1751836116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7f98a4-485e-4394-b137-b713e4ce837c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea35c19fc1914332acb1d02bc15d507c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:00Z,use_quota=True,user_id='958074fe02a740fea451af850fc5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eda649-ab7a-4e84-bafa-d51b99c94f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8eda649-ab7a-4e84-bafa-d51b99c94f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ca8aae-3327-4f5e-aed0-a3f3423c2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:20:00 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-82229a04-9806-4efd-8939-ae210712d02f" returned: 0 in 0.388s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-quobyte-82229a04-9806-4efd-8939-ae210712d02f" released by "delete_volume" :: held 1.243s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Created reservations ['f86f0344-daa7-4a78-8b31-6ee84a4a3860', '558a979d-797c-457b-80f6-5f5a31556f7d', '3c4d78ca-8f60-4538-aafb-3b577a7249d2', '027a7819-30e8-44be-ad8a-cdb16817edf7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ca8aae-3327-4f5e-aed0-a3f3423c2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b7f98a4-485e-4394-b137-b713e4ce837c', 'volume_name': 'volume-2b7f98a4-485e-4394-b137-b713e4ce837c', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1f7e76-efd5-4977-b6ae-0e8c5e0004a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1f7e76-efd5-4977-b6ae-0e8c5e0004a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf250dc1-9315-459e-9bd9-5b1aa8261a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:00 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Volume 2b7f98a4-485e-4394-b137-b713e4ce837c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b7f98a4-485e-4394-b137-b713e4ce837c', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Trying to clone 2b7f98a4-485e-4394-b137-b713e4ce837c from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:00 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:20:00 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:01 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.437s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:20:01 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Deleted volume successfully. Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5764c91a-29fd-4af3-ac9c-b0fe325edeb9 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-82229a04-9806-4efd-8939-ae210712d02f-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "cinder-075309ac-6271-4a1f-9f62-6864aa6d25a7-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-075309ac-6271-4a1f-9f62-6864aa6d25a7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:20:01 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Image download 20.69 MB at 20.69 MB/s Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "cinder-quobyte-075309ac-6271-4a1f-9f62-6864aa6d25a7" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfd3ffe-ddaf-4e1d-9fea-c5f2bc623947]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-quobyte-075309ac-6271-4a1f-9f62-6864aa6d25a7" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f300b51f-8874-44e5-a08e-a9f5718e63d5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:02 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD Aug 19 00:20:02 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:02 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 Aug 19 00:20:02 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:02 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:02 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 is fetched for user 958074fe02a740fea451af850fc5ab6c. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:20:02 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7" returned: 0 in 0.719s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7e818-2a22-4feb-baab-e471e2bacc1c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:02 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7 Aug 19 00:20:02 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:02 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD Aug 19 00:20:02 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:03 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1751836116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7f98a4-485e-4394-b137-b713e4ce837c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea35c19fc1914332acb1d02bc15d507c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:00Z,use_quota=True,user_id='958074fe02a740fea451af850fc5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Creating volume 2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:20:03 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:03 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 1073741824 Aug 19 00:20:03 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:03 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-075309ac-6271-4a1f-9f62-6864aa6d25a7" returned: 0 in 0.848s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-quobyte-075309ac-6271-4a1f-9f62-6864aa6d25a7" released by "delete_volume" :: held 1.657s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Created reservations ['4eafe313-ad13-46c6-8654-aa5a200c5334', '4af66795-0795-41ff-a789-6ba9f73f1185', '7d2043f2-9781-44e3-8cb8-4dbe731aa908', '32fde14f-6ec4-4a17-b80b-9ed4564518e9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:03 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:20:03 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:04 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 1073741824" returned: 0 in 1.068s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:04 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.567s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:04 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:20:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Deleted volume successfully. Aug 19 00:20:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f7082796-5f65-4cb0-9063-f5cb43ce03e1 tempest-TestServerVolumeAttachmentScenario-939137365 None] Lock "cinder-075309ac-6271-4a1f-9f62-6864aa6d25a7-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:04 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c Aug 19 00:20:04 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:05 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c" returned: 0 in 0.651s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=104,cinder:DELETE=10,cinder:SELECT=110,cinder:INSERT=33 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=116,cinder:SELECT=109,cinder:DELETE=7,cinder:INSERT=33 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Attempting download of 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume 2b7f98a4-485e-4394-b137-b713e4ce837c. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfaf143-5f0b-4629-8b48-045325da6686]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:05 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb Aug 19 00:20:05 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:05 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb" returned: 0 in 0.557s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:05 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb Aug 19 00:20:05 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:06 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb" returned: 1 in 0.562s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_edf8odrb' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cc559d-3d98-43a9-a9df-57bb5ba4c3cd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:06 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD Aug 19 00:20:06 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:06 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] 71a9806a-90d3-4b78-b2e4-4f74e1036e43 was qcow2, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:20:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:06 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c Aug 19 00:20:06 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:09 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c" returned: 0 in 2.589s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_r7ciopiqdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:20:09 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Converted 112.00 MB image at 43.16 MB/s Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:09 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 1G Aug 19 00:20:09 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:09 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 1G" returned: 0 in 0.574s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Downloaded image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume 2b7f98a4-485e-4394-b137-b713e4ce837c successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 for user 958074fe02a740fea451af850fc5ab6c is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:20:09 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Marking volume 2b7f98a4-485e-4394-b137-b713e4ce837c as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Copying metadata from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 to 2b7f98a4-485e-4394-b137-b713e4ce837c. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Creating volume glance metadata for volume 2b7f98a4-485e-4394-b137-b713e4ce837c backed by image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf250dc1-9315-459e-9bd9-5b1aa8261a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7f98a4-485e-4394-b137-b713e4ce837c', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4aed78-ebbd-4329-ad46-44ad7c5f501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Volume volume-2b7f98a4-485e-4394-b137-b713e4ce837c (2b7f98a4-485e-4394-b137-b713e4ce837c): created successfully Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4aed78-ebbd-4329-ad46-44ad7c5f501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Flow 'volume_create_manager' (3152510b-d052-4df1-ae69-34344a31dd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-309107cd-a201-466c-a73e-3cdec24d5c14 tempest-VolumesExtendTest-870710453 None] Created volume successfully. Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c073eef-35cd-43ce-8a5b-714e55e4ba1c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:10 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c Aug 19 00:20:10 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:11 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 2G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c 2G" returned: 0 in 0.150s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.663s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8535fe20-db1d-48e7-b275-6d3c1236e9e6 tempest-VolumesExtendTest-870710453 None] Extend volume completed successfully. Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-2b7f98a4-485e-4394-b137-b713e4ce837c-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Lock "cinder-2b7f98a4-485e-4394-b137-b713e4ce837c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-quobyte-2b7f98a4-485e-4394-b137-b713e4ce837c" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-2b7f98a4-485e-4394-b137-b713e4ce837c" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfe47b2-bd38-4e2b-b0f7-bcc14878d676]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:12 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c Aug 19 00:20:12 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:12 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c" returned: 0 in 0.579s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:13 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c Aug 19 00:20:13 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:13 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2b7f98a4-485e-4394-b137-b713e4ce837c" returned: 0 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-2b7f98a4-485e-4394-b137-b713e4ce837c" released by "delete_volume" :: held 0.979s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:13 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:20:13 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Created reservations ['34c0d0c4-9b7b-46c5-9062-63a2742121d5', '4a59ad46-a1aa-417b-8287-c6f3e2508566', 'c1ec6589-cfe2-4707-82f8-19fc79f883c2', '3161ec8a-0348-4240-a133-a0d0a9d05e7f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:13 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:20:13 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:13 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:13 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:20:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Deleted volume successfully. Aug 19 00:20:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4b7f0d99-7739-472d-906f-611b114001f3 tempest-VolumesExtendTest-870710453 None] Lock "cinder-2b7f98a4-485e-4394-b137-b713e4ce837c-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Flow 'volume_create_manager' (d3792faa-53b7-496c-9bb1-08e3a67dfbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157ef999-d635-4397-bd69-028a32cf768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157ef999-d635-4397-bd69-028a32cf768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1553901753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e089f052-2bf9-4aa4-920f-e6a9e05f3ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea35c19fc1914332acb1d02bc15d507c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:15Z,use_quota=True,user_id='958074fe02a740fea451af850fc5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f363b187-b799-459e-a759-6bc9b2170a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f363b187-b799-459e-a759-6bc9b2170a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954878b3-a1c8-48d1-9779-912cfd4d56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954878b3-a1c8-48d1-9779-912cfd4d56ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e089f052-2bf9-4aa4-920f-e6a9e05f3ae2', 'volume_name': 'volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e05a0c-23e8-42ee-87f7-e12129276464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e05a0c-23e8-42ee-87f7-e12129276464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa06a5c-245a-41fc-aa5d-e90db57acc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Volume e089f052-2bf9-4aa4-920f-e6a9e05f3ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2', 'volume_size': 1} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1553901753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e089f052-2bf9-4aa4-920f-e6a9e05f3ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea35c19fc1914332acb1d02bc15d507c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:15Z,use_quota=True,user_id='958074fe02a740fea451af850fc5ab6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Creating volume e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:20:15 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:15 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 1073741824 Aug 19 00:20:15 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:15 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 1073741824" returned: 0 in 0.475s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:15 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 Aug 19 00:20:15 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:16 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" returned: 0 in 0.320s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa06a5c-245a-41fc-aa5d-e90db57acc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7655f0b0-867a-4822-8849-c59e84e0e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:16 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Volume volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 (e089f052-2bf9-4aa4-920f-e6a9e05f3ae2): created successfully Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7655f0b0-867a-4822-8849-c59e84e0e53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Flow 'volume_create_manager' (d3792faa-53b7-496c-9bb1-08e3a67dfbc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7cb68655-b432-4d3a-aac0-9e0e92d75154 tempest-VolumesExtendTest-870710453 None] Created volume successfully. Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Creating offline snapshot 9b165423-e928-4bf0-9948-79388f1a1c17 of volume e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[20267c11-543a-4cdb-bb26-bd58e49a6375]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:17 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 Aug 19 00:20:17 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:17 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" returned: 0 in 0.405s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:17 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 1G Aug 19 00:20:17 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:18 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 1G" returned: 0 in 0.537s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:18 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 Aug 19 00:20:18 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:18 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17" returned: 0 in 0.365s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:18 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 is being set with open permissions: ugo+rw Aug 19 00:20:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:18 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 Aug 19 00:20:18 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:19 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17" returned: 0 in 0.304s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:19 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info Aug 19 00:20:19 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:19 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:19 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info is being set with open permissions: ugo+rw Aug 19 00:20:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:19 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info Aug 19 00:20:19 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:19 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.info" returned: 0 in 0.402s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-806c746a-19fc-4ca1-836f-6015da09a0dc tempest-VolumesExtendTest-870710453 None] Create snapshot completed successfully Aug 19 00:20:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d3102-0381-46e9-a8b6-825a5c469e6c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:20 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 Aug 19 00:20:20 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:21 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" returned: 0 in 0.485s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 2G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 2G" returned: 0 in 0.158s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.691s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f1afeb5e-b3b3-4122-8963-1fcf9a981594 tempest-VolumesExtendTest-870710453 None] Extend volume completed successfully. Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-9b165423-e928-4bf0-9948-79388f1a1c17-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Lock "cinder-9b165423-e928-4bf0-9948-79388f1a1c17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-quobyte-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-quobyte-9b165423-e928-4bf0-9948-79388f1a1c17" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-9b165423-e928-4bf0-9948-79388f1a1c17" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Deleting offline snapshot 9b165423-e928-4bf0-9948-79388f1a1c17 of volume e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] snapshot_file for this snap is: volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60621efc-3839-4381-bb30-edc665585f8f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:22 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 Aug 19 00:20:22 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:22 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17" returned: 0 in 0.426s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb41e92d-6907-4247-8d75-354cd650d47d]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:22 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 Aug 19 00:20:22 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:23 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" returned: 0 in 0.706s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:23 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 Aug 19 00:20:23 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:24 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17" returned: 0 in 0.699s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:24 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17 Aug 19 00:20:24 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:24 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2.9b165423-e928-4bf0-9948-79388f1a1c17" returned: 0 in 0.324s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-9b165423-e928-4bf0-9948-79388f1a1c17" released by "_delete_snapshot" :: held 2.333s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" released by "delete_snapshot" :: held 2.368s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Created reservations ['2b7263a6-7adb-4086-bfa5-00f6bb5c2bac', '7d4cbd4b-5754-4d0c-b167-34c97af35a41', '59594d48-85c3-41a3-a928-9bf63b4aea78', '93ca5e28-22d7-4ec4-a3d8-c50d35fbb8bc'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:20:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Delete snapshot completed successfully. Aug 19 00:20:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3c80f000-25e7-411b-941e-d24090edc879 tempest-VolumesExtendTest-870710453 None] Lock "cinder-9b165423-e928-4bf0-9948-79388f1a1c17-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Lock "cinder-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Acquiring lock "cinder-quobyte-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f4a0f-25fb-4445-94c1-fc2d47d6b53b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:25 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 Aug 19 00:20:25 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:26 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" returned: 0 in 0.424s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:26 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2 Aug 19 00:20:26 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:26 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" returned: 0 in 0.305s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Lock "cinder-quobyte-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2" released by "delete_volume" :: held 0.803s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Created reservations ['5c979b2a-60cd-4bfa-8a2e-a44c9bbe9de7', '32ff01cb-56da-4bf2-a20f-001ed55e02a3', '6192dc2d-4aff-4687-b817-e0d3f28f1e30', '0afcf718-4d4d-47ab-ba75-c566250936eb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:26 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:20:26 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:26 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.389s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:20:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Deleted volume successfully. Aug 19 00:20:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f8e9538-ed38-487a-95e6-83b91fb98c11 tempest-VolumesExtendTest-870710453 None] Lock "cinder-e089f052-2bf9-4aa4-920f-e6a9e05f3ae2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Flow 'volume_create_manager' (85e5d1f2-1de8-46ee-9b14-d339ea2413f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d987bce-8414-402a-8363-5b75031b21b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d987bce-8414-402a-8363-5b75031b21b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1981774943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1664bab-8893-4bf1-b0a6-d98c17cdb4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc959ea8c5be4c9e8319c719f7fb2145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:28Z,use_quota=True,user_id='2381b371f04a4520814958ca5236a14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d93038-8458-41f7-a334-238c57d86205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d93038-8458-41f7-a334-238c57d86205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccb7511-ca96-42d5-b3ca-2185341bc97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccb7511-ca96-42d5-b3ca-2185341bc97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1664bab-8893-4bf1-b0a6-d98c17cdb4ce', 'volume_name': 'volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bc378f-0fc2-40b5-829d-9c446fd45434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bc378f-0fc2-40b5-829d-9c446fd45434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47df77f-8c1b-4eaf-8a7a-ceb0fd25afdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Volume f1664bab-8893-4bf1-b0a6-d98c17cdb4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce', 'volume_size': 1} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1981774943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1664bab-8893-4bf1-b0a6-d98c17cdb4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc959ea8c5be4c9e8319c719f7fb2145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:28Z,use_quota=True,user_id='2381b371f04a4520814958ca5236a14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Creating volume f1664bab-8893-4bf1-b0a6-d98c17cdb4ce {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:20:27 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:20:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:27 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce 1073741824 Aug 19 00:20:27 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Flow 'volume_create_manager' (dabd08df-6adc-4826-bfa1-9af59e5ff389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f6f768-8e54-4eb2-9713-c3b1641561e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f6f768-8e54-4eb2-9713-c3b1641561e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825692689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9c5f49-feb4-4420-8223-9e6ad3778de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6749442019374c479981c4ca0f1ce079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:28Z,use_quota=True,user_id='4f6ac512285345959d3098f67563a0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd28c5-a1d7-4604-8177-6535bd3e8650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccd28c5-a1d7-4604-8177-6535bd3e8650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1dd5f6-ae46-4fa7-835d-4ee391cdbce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:20:28 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce 1073741824" returned: 0 in 0.684s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:28 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce Aug 19 00:20:28 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1dd5f6-ae46-4fa7-835d-4ee391cdbce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de9c5f49-feb4-4420-8223-9e6ad3778de6', 'volume_name': 'volume-de9c5f49-feb4-4420-8223-9e6ad3778de6', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe652c2-4c17-49ac-9688-1a204e714439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:28 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe652c2-4c17-49ac-9688-1a204e714439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5993623-977f-4949-9458-13f47c172a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:28 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Volume de9c5f49-feb4-4420-8223-9e6ad3778de6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de9c5f49-feb4-4420-8223-9e6ad3778de6', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Trying to clone de9c5f49-feb4-4420-8223-9e6ad3778de6 from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce" returned: 0 in 0.345s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:20:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47df77f-8c1b-4eaf-8a7a-ceb0fd25afdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0d7250-241b-4419-8344-6cb07bf4cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Volume volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce (f1664bab-8893-4bf1-b0a6-d98c17cdb4ce): created successfully Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0d7250-241b-4419-8344-6cb07bf4cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Flow 'volume_create_manager' (85e5d1f2-1de8-46ee-9b14-d339ea2413f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6fb44cfb-23a8-4333-8abd-d595fa17d5dc tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Created volume successfully. Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:20:29 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Image download 20.69 MB at 20.69 MB/s Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c39829-ca65-4b49-9b17-1fd11b98e3c0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:29 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD Aug 19 00:20:29 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:29 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:29 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 is fetched for user 4f6ac512285345959d3098f67563a0d0. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c89f1-2aab-4c6b-a7e4-389b57a4a305]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:30 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD Aug 19 00:20:30 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:30 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825692689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9c5f49-feb4-4420-8223-9e6ad3778de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6749442019374c479981c4ca0f1ce079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:28Z,use_quota=True,user_id='4f6ac512285345959d3098f67563a0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Creating volume de9c5f49-feb4-4420-8223-9e6ad3778de6 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:20:30 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:30 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 1073741824 Aug 19 00:20:30 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-f311aa02-dab4-4470-b1e9-66d2593c5f76 req-b44f84fd-9b25-44e8-b0d5-d791c3c08d33 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:31 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 1073741824" returned: 0 in 0.578s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:31 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 Aug 19 00:20:31 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:31 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-f311aa02-dab4-4470-b1e9-66d2593c5f76 req-b44f84fd-9b25-44e8-b0d5-d791c3c08d33 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.723s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-f311aa02-dab4-4470-b1e9-66d2593c5f76 req-b44f84fd-9b25-44e8-b0d5-d791c3c08d33 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Attempting download of 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume de9c5f49-feb4-4420-8223-9e6ad3778de6. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-f311aa02-dab4-4470-b1e9-66d2593c5f76 req-b44f84fd-9b25-44e8-b0d5-d791c3c08d33 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '075a9c60-a8cc-4ce2-a36e-1860fda7b295', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3395e6-040e-42a0-9e37-02a4ba772bf0]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-f311aa02-dab4-4470-b1e9-66d2593c5f76 req-b44f84fd-9b25-44e8-b0d5-d791c3c08d33 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] attachment_update completed successfully. Aug 19 00:20:31 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt Aug 19 00:20:31 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:32 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt" returned: 0 in 0.481s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:32 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt Aug 19 00:20:32 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:32 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt" returned: 1 in 0.425s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71a9806a-90d3-4b78-b2e4-4f74e1036e43_85lc_qtt' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:20:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915772e-2e38-4572-b104-02592fed8863]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:32 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD Aug 19 00:20:32 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:33 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:33 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] 71a9806a-90d3-4b78-b2e4-4f74e1036e43 was qcow2, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:20:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:33 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 Aug 19 00:20:33 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:35 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6" returned: 0 in 2.439s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:35 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71a9806a-90d3-4b78-b2e4-4f74e1036e43_ki20fc3gdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:20:35 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Converted 112.00 MB image at 45.90 MB/s Aug 19 00:20:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:35 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 1G Aug 19 00:20:35 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:36 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 1G" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Downloaded image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}])) to volume de9c5f49-feb4-4420-8223-9e6ad3778de6 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Temporary image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 for user 4f6ac512285345959d3098f67563a0d0 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Marking volume de9c5f49-feb4-4420-8223-9e6ad3778de6 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:20:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-0b0951d5-b9be-46c5-87fd-ec0ae118716f req-5170a604-4874-4f8c-8335-877ec9ff275e tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Terminate volume connection completed successfully. Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-0b0951d5-b9be-46c5-87fd-ec0ae118716f req-5170a604-4874-4f8c-8335-877ec9ff275e tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Deleting attachment 075a9c60-a8cc-4ce2-a36e-1860fda7b295. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Copying metadata from image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 to de9c5f49-feb4-4420-8223-9e6ad3778de6. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Creating volume glance metadata for volume de9c5f49-feb4-4420-8223-9e6ad3778de6 backed by image 71a9806a-90d3-4b78-b2e4-4f74e1036e43 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5993623-977f-4949-9458-13f47c172a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9c5f49-feb4-4420-8223-9e6ad3778de6', 'volume_size': 1, 'image_id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45d44f4a3b6441dbb210d6b997a6ad4c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71a9806a-90d3-4b78-b2e4-4f74e1036e43', 'created_at': datetime.datetime(2026, 8, 18, 22, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 2, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71a9806a-90d3-4b78-b2e4-4f74e1036e43/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b50416-e93d-49c1-89e6-801167d2f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Volume volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 (de9c5f49-feb4-4420-8223-9e6ad3778de6): created successfully Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b50416-e93d-49c1-89e6-801167d2f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Flow 'volume_create_manager' (dabd08df-6adc-4826-bfa1-9af59e5ff389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8b75d2ca-edcd-4fdb-bd5c-4f77beb5ce6c tempest-TestShelveInstance-1486191736 None] Created volume successfully. Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Acquiring lock "cinder-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "cinder-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Acquiring lock "cinder-quobyte-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "cinder-quobyte-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c722b0ec-c53d-43e2-8785-43d74e66bf76]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:37 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce Aug 19 00:20:37 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:37 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:37 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce Aug 19 00:20:37 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:37 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce" returned: 0 in 0.332s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "cinder-quobyte-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce" released by "delete_volume" :: held 0.878s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Created reservations ['5d86eee6-b1d8-454d-b05a-8b24c3463727', 'd857101a-3d5b-43d6-873e-21d963fd2526', 'a3b3cd63-4dc6-4584-939c-e622b29c7220', 'ed097ca0-1ae7-4962-99d0-576baab5172f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:38 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:20:38 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:38 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.286s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:20:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Deleted volume successfully. Aug 19 00:20:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb51ed55-ae2a-4d98-aeb7-93909b4e4270 tempest-TestServerVolumeAttachScenarioOldVersion-878742402 None] Lock "cinder-f1664bab-8893-4bf1-b0a6-d98c17cdb4ce-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:20:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-0898abff-f566-475d-a74c-bbb2700b01ea req-ebf89309-e90a-4cbe-b979-b7f9e5ab640a tempest-TestShelveInstance-1486191736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-0898abff-f566-475d-a74c-bbb2700b01ea req-ebf89309-e90a-4cbe-b979-b7f9e5ab640a tempest-TestShelveInstance-1486191736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-0898abff-f566-475d-a74c-bbb2700b01ea req-ebf89309-e90a-4cbe-b979-b7f9e5ab640a tempest-TestShelveInstance-1486191736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-0898abff-f566-475d-a74c-bbb2700b01ea req-ebf89309-e90a-4cbe-b979-b7f9e5ab640a tempest-TestShelveInstance-1486191736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-de9c5f49-feb4-4420-8223-9e6ad3778de6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c6d17fe-8372-482a-9ea4-4f7a78cc803d', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:20:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-0898abff-f566-475d-a74c-bbb2700b01ea req-ebf89309-e90a-4cbe-b979-b7f9e5ab640a tempest-TestShelveInstance-1486191736 None] attachment_update completed successfully. Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Flow 'volume_create_manager' (6921574a-f5ad-4c2a-947f-5c0a880f1392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4408151c-9273-4336-a348-c23a73c7a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4408151c-9273-4336-a348-c23a73c7a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1464338248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c005f58f-6348-4bb3-b57b-ee819ddf6d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad94e22ec3b648d5bdf4c5b902a0d22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:55Z,use_quota=True,user_id='8e3633a878824239a3e7f12792484d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686f319c-c80d-4d5a-a415-d0a5220584f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686f319c-c80d-4d5a-a415-d0a5220584f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688df4a9-da13-4afb-a65f-03050c179a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688df4a9-da13-4afb-a65f-03050c179a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c005f58f-6348-4bb3-b57b-ee819ddf6d25', 'volume_name': 'volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de029b34-7d62-44e2-86fe-5aca47a23526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de029b34-7d62-44e2-86fe-5aca47a23526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447d19ee-5077-4514-829b-85d1cb36c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:55 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Volume c005f58f-6348-4bb3-b57b-ee819ddf6d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25', 'volume_size': 1} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1464338248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c005f58f-6348-4bb3-b57b-ee819ddf6d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad94e22ec3b648d5bdf4c5b902a0d22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:20:55Z,use_quota=True,user_id='8e3633a878824239a3e7f12792484d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Creating volume c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:20:55 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:55 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 1073741824 Aug 19 00:20:55 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:55 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 1073741824" returned: 0 in 0.499s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:55 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 Aug 19 00:20:55 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:56 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25" returned: 0 in 0.300s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447d19ee-5077-4514-829b-85d1cb36c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c1082-9ef8-4e28-aa09-2bca96fee6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:20:56 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Volume volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 (c005f58f-6348-4bb3-b57b-ee819ddf6d25): created successfully Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c1082-9ef8-4e28-aa09-2bca96fee6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:20:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Flow 'volume_create_manager' (6921574a-f5ad-4c2a-947f-5c0a880f1392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:20:56 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ba7c9933-e361-4d37-8668-1ce0be169271 tempest-TestImageHashVerification-1594052581 None] Created volume successfully. Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e30c1a-50f1-4a97-bdd7-cdefe82f0fd3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:58 devstack sudo[109799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 Aug 19 00:20:58 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:58 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7855b0-4b7f-434c-bc66-2370b745d3ba]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:20:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:58 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 Aug 19 00:20:58 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:20:59 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Aug 19 00:20:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25" returned: 0 in 0.561s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:20:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 /opt/stack/data/cinder/conversion/c005f58f-6348-4bb3-b57b-ee819ddf6d25.temp_image.df6747dd-7bb5-468a-8810-3fa38a47dc14ge6b718k.img {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:20:59 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 /opt/stack/data/cinder/conversion/c005f58f-6348-4bb3-b57b-ee819ddf6d25.temp_image.df6747dd-7bb5-468a-8810-3fa38a47dc14ge6b718k.img Aug 19 00:20:59 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:06 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=56,cinder:INSERT=29,cinder:SELECT=57,cinder:DELETE=3 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:21:06 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 /opt/stack/data/cinder/conversion/c005f58f-6348-4bb3-b57b-ee819ddf6d25.temp_image.df6747dd-7bb5-468a-8810-3fa38a47dc14ge6b718k.img" returned: 0 in 7.406s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:06 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[822333f3-9872-4c47-b0fd-2f3f9552463b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:06 devstack sudo[110290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 Aug 19 00:21:06 devstack sudo[110290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:07 devstack sudo[110290]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25" returned: 0 in 1.111s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:07 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/conversion/c005f58f-6348-4bb3-b57b-ee819ddf6d25.temp_image.df6747dd-7bb5-468a-8810-3fa38a47dc14ge6b718k.img {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:21:07 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Converted 1024.00 MB image at 138.21 MB/s Aug 19 00:21:07 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] df6747dd-7bb5-468a-8810-3fa38a47dc14 was raw, no need to convert to raw {{(pid=94243) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 19 00:21:08 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=71,cinder:INSERT=17,cinder:UPDATE=54,cinder:DELETE=6 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:21:09 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Flow 'volume_create_manager' (19439aa0-281e-47f2-915c-4fc5112e4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35689bdd-8337-4871-b4ed-83b1f4786b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35689bdd-8337-4871-b4ed-83b1f4786b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-273541786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1416a99d-77d1-41a4-a70d-c5e4f12639a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbac8aaa3364722bdd99fc5e5ff2b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:10Z,use_quota=True,user_id='f6741633587547138ba14fbb9949cd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ed9b9b0-9d17-4574-9413-4bab1cfc801d),volume_type_id=2ed9b9b0-9d17-4574-9413-4bab1cfc801d)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88973a1-6599-4b49-94a3-51121137165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88973a1-6599-4b49-94a3-51121137165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90c7c5e-7bed-47c5-8162-43b3bc8ffd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90c7c5e-7bed-47c5-8162-43b3bc8ffd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1416a99d-77d1-41a4-a70d-c5e4f12639a7', 'volume_name': 'volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed51ec4-086e-4909-818c-87df4c17b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed51ec4-086e-4909-818c-87df4c17b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d6a3b9-a00e-4f0f-a310-ac3b7b0d475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume 1416a99d-77d1-41a4-a70d-c5e4f12639a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7', 'volume_size': 1} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Flow 'volume_create_manager' (6fc1dbcd-0693-4a35-b651-98c70f2f703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c55bda-f978-492e-8483-c6bd154e9fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c55bda-f978-492e-8483-c6bd154e9fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-568615437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cafa8d3-f1f8-49eb-b207-dfeb948879d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbac8aaa3364722bdd99fc5e5ff2b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:11Z,use_quota=True,user_id='f6741633587547138ba14fbb9949cd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f544e3e-fb54-49af-9193-2452f141184c),volume_type_id=6f544e3e-fb54-49af-9193-2452f141184c)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6557b4-f015-45d8-a8ec-8a9c1a9711bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6557b4-f015-45d8-a8ec-8a9c1a9711bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcdcc09-7650-499f-8cfa-6db3674224ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcdcc09-7650-499f-8cfa-6db3674224ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cafa8d3-f1f8-49eb-b207-dfeb948879d4', 'volume_name': 'volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af23018-b295-46ea-b2e9-1e9709d32579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af23018-b295-46ea-b2e9-1e9709d32579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25930a6c-a547-4482-b36b-2219ba6a9d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume 6cafa8d3-f1f8-49eb-b207-dfeb948879d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4', 'volume_size': 1} Aug 19 00:21:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Flow 'volume_create_manager' (fee469a5-a2f0-4da7-a940-d89fdeb567cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd25cc4-0a5f-40fa-9ee4-35dafb91f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd25cc4-0a5f-40fa-9ee4-35dafb91f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1926431535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff7b18d-a4e2-46b8-b815-4913916846e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbac8aaa3364722bdd99fc5e5ff2b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:12Z,use_quota=True,user_id='f6741633587547138ba14fbb9949cd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6e24e0-0ad1-46b1-9d4d-00db6b241ef4),volume_type_id=9e6e24e0-0ad1-46b1-9d4d-00db6b241ef4)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3f914a-105a-4bdd-ae07-351e090c153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3f914a-105a-4bdd-ae07-351e090c153b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f26e7d-5128-42eb-b1bc-423f9ef35ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f26e7d-5128-42eb-b1bc-423f9ef35ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ff7b18d-a4e2-46b8-b815-4913916846e9', 'volume_name': 'volume-0ff7b18d-a4e2-46b8-b815-4913916846e9', 'volume_size': 1, 'image_id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--610309209', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5dbac8aaa3364722bdd99fc5e5ff2b5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'created_at': datetime.datetime(2026, 8, 18, 22, 21, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 21, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529/file', 'properties': {}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b2e4d0-da53-4f62-9cd6-cbb756f0728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b2e4d0-da53-4f62-9cd6-cbb756f0728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba55b09-b8c2-481a-a86d-b3eb29999d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume 0ff7b18d-a4e2-46b8-b815-4913916846e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ff7b18d-a4e2-46b8-b815-4913916846e9', 'volume_size': 1, 'image_id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--610309209', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5dbac8aaa3364722bdd99fc5e5ff2b5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'created_at': datetime.datetime(2026, 8, 18, 22, 21, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 21, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529/file', 'properties': {}}, 'image_service': } Aug 19 00:21:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Trying to clone 0ff7b18d-a4e2-46b8-b815-4913916846e9 from image 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:13 devstack sudo[110309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:21:13 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:14 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.809s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:14 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:21:14 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:21:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:21:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:21:20 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD, size 20.69 MB, duration 7.04 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:21:20 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Image download 20.69 MB at 2.94 MB/s Aug 19 00:21:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489f6fc-b939-4ef7-b8c1-fac4ed3414a6]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:20 devstack sudo[110341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD Aug 19 00:21:20 devstack sudo[110341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:20 devstack sudo[110341]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:20 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Temporary image 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 is fetched for user f6741633587547138ba14fbb9949cd10. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:21:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced41091-9de4-4679-b225-1eafcee653a6]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:21 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD Aug 19 00:21:21 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:21 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (17df0ebb-7cc0-4a06-83dd-f264021173af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eec9d2-6b8f-4d7f-8122-aeb7a89b0b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47eec9d2-6b8f-4d7f-8122-aeb7a89b0b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899922320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4c7533-48cb-4810-957f-94ccb96f037a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:23Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2ffca5-ac30-40ad-93c4-c1c5a2e2933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2ffca5-ac30-40ad-93c4-c1c5a2e2933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139cbc34-231d-4f2c-8f7a-205e029ca157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139cbc34-231d-4f2c-8f7a-205e029ca157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4c7533-48cb-4810-957f-94ccb96f037a', 'volume_name': 'volume-9e4c7533-48cb-4810-957f-94ccb96f037a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0c72f4-31ee-406c-88d8-fdeb4b9e66b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0c72f4-31ee-406c-88d8-fdeb4b9e66b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e93e60d-2837-4f73-baa3-7775928af66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:23 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume 9e4c7533-48cb-4810-957f-94ccb96f037a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4c7533-48cb-4810-957f-94ccb96f037a', 'volume_size': 1} Aug 19 00:21:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.701s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Uploaded volume to glance image-id: df6747dd-7bb5-468a-8810-3fa38a47dc14. {{(pid=94243) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.830s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-273541786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1416a99d-77d1-41a4-a70d-c5e4f12639a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbac8aaa3364722bdd99fc5e5ff2b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:10Z,use_quota=True,user_id='f6741633587547138ba14fbb9949cd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ed9b9b0-9d17-4574-9413-4bab1cfc801d),volume_type_id=2ed9b9b0-9d17-4574-9413-4bab1cfc801d)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Creating volume 1416a99d-77d1-41a4-a70d-c5e4f12639a7 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:33 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:33 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 1073741824 Aug 19 00:21:33 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1e3b2e47-457a-463d-abc2-f8651517d05f tempest-TestImageHashVerification-1594052581 None] Copy volume to image completed successfully. Aug 19 00:21:34 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 1073741824" returned: 0 in 0.535s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:34 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 Aug 19 00:21:34 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:34 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7" returned: 0 in 0.250s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.711s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-568615437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cafa8d3-f1f8-49eb-b207-dfeb948879d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbac8aaa3364722bdd99fc5e5ff2b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:11Z,use_quota=True,user_id='f6741633587547138ba14fbb9949cd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f544e3e-fb54-49af-9193-2452f141184c),volume_type_id=6f544e3e-fb54-49af-9193-2452f141184c)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Creating volume 6cafa8d3-f1f8-49eb-b207-dfeb948879d4 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:34 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d6a3b9-a00e-4f0f-a310-ac3b7b0d475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:34 devstack sudo[110428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 1073741824 Aug 19 00:21:34 devstack sudo[110428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5ac810-44c1-48be-8bf7-95ae75f2ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 (1416a99d-77d1-41a4-a70d-c5e4f12639a7): created successfully Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5ac810-44c1-48be-8bf7-95ae75f2ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Flow 'volume_create_manager' (19439aa0-281e-47f2-915c-4fc5112e4112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cc7aaa82-79a9-40f9-b672-5a61958f3540 tempest-TestInstancesWithCinderVolumes-1662922289 None] Created volume successfully. Aug 19 00:21:35 devstack sudo[110428]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 1073741824" returned: 0 in 0.498s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:35 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 Aug 19 00:21:35 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Acquiring lock "cinder-c005f58f-6348-4bb3-b57b-ee819ddf6d25-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Lock "cinder-c005f58f-6348-4bb3-b57b-ee819ddf6d25-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Acquiring lock "cinder-quobyte-c005f58f-6348-4bb3-b57b-ee819ddf6d25" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Lock "cinder-quobyte-c005f58f-6348-4bb3-b57b-ee819ddf6d25" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad8e22b-701f-4983-8302-8353fae233cd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:35 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:35 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4" returned: 0 in 0.390s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:35 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.211s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1926431535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff7b18d-a4e2-46b8-b815-4913916846e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbac8aaa3364722bdd99fc5e5ff2b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:12Z,use_quota=True,user_id='f6741633587547138ba14fbb9949cd10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e6e24e0-0ad1-46b1-9d4d-00db6b241ef4),volume_type_id=9e6e24e0-0ad1-46b1-9d4d-00db6b241ef4)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Creating volume 0ff7b18d-a4e2-46b8-b815-4913916846e9 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:35 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:35 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 1073741824 Aug 19 00:21:35 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25930a6c-a547-4482-b36b-2219ba6a9d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a07a98-34ff-4a66-a368-f0cd6ca62100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 (6cafa8d3-f1f8-49eb-b207-dfeb948879d4): created successfully Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a07a98-34ff-4a66-a368-f0cd6ca62100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Flow 'volume_create_manager' (6fc1dbcd-0693-4a35-b651-98c70f2f703d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-660faedd-2305-453b-8e7b-044031a05e7f tempest-TestInstancesWithCinderVolumes-1662922289 None] Created volume successfully. Aug 19 00:21:36 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25" returned: 0 in 0.578s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:36 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25 Aug 19 00:21:36 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:36 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 1073741824" returned: 0 in 0.752s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:36 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c005f58f-6348-4bb3-b57b-ee819ddf6d25" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Lock "cinder-quobyte-c005f58f-6348-4bb3-b57b-ee819ddf6d25" released by "delete_volume" :: held 1.057s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:36 devstack sudo[110471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 Aug 19 00:21:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-ca85f71e-4303-4c68-9b58-361c17ac717c req-dd8b3109-72c3-4379-bc13-90349c9e3129 tempest-TestShelveInstance-1486191736 None] Terminate volume connection completed successfully. Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-ca85f71e-4303-4c68-9b58-361c17ac717c req-dd8b3109-72c3-4379-bc13-90349c9e3129 tempest-TestShelveInstance-1486191736 None] Deleting attachment 1c6d17fe-8372-482a-9ea4-4f7a78cc803d. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:21:36 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Created reservations ['d2cb9877-5bf7-4ae0-9b2e-32d9239d6e66', 'efe824db-699f-4a8f-a1a1-168b7fc58c27', 'd936ec03-7579-4694-9a05-ea9b5c2ba92b', 'a528506d-9c81-4c0a-94de-7c43eac7661b'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:36 devstack sudo[110473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:21:36 devstack sudo[110473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:36 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9" returned: 0 in 0.315s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.627s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1899922320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4c7533-48cb-4810-957f-94ccb96f037a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:23Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating volume 9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:36 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:37 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a 1073741824 Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Attempting download of 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 ((None, [{'url': 'file:///opt/stack/data/glance/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'metadata': {}}])) to volume 0ff7b18d-a4e2-46b8-b815-4913916846e9. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:21:37 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbe9039-1239-47e9-aec7-0d3473beddbf]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:37 devstack sudo[110473]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.345s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:21:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Deleted volume successfully. Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d01fbf14-b4e7-4872-ab44-9cc4fd799717 tempest-TestImageHashVerification-1594052581 None] Lock "cinder-c005f58f-6348-4bb3-b57b-ee819ddf6d25-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:37 devstack sudo[110479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x Aug 19 00:21:37 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:37 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a 1073741824" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:37 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:37 devstack sudo[110486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a Aug 19 00:21:37 devstack sudo[110486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:37 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x Aug 19 00:21:37 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:37 devstack sudo[110486]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e93e60d-2837-4f73-baa3-7775928af66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4c7533-48cb-4810-957f-94ccb96f037a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0a7085-e4de-47f6-8f2c-ae4c1d034d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:37 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume volume-9e4c7533-48cb-4810-957f-94ccb96f037a (9e4c7533-48cb-4810-957f-94ccb96f037a): created successfully Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0a7085-e4de-47f6-8f2c-ae4c1d034d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (17df0ebb-7cc0-4a06-83dd-f264021173af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e497b2db-9227-4b43-a98a-075a18dee4a4 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created volume successfully. Aug 19 00:21:37 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x" returned: 1 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_73sdg17x' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76de456-30e3-41a2-9320-67e1aaa4fcbf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:37 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD Aug 19 00:21:37 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:38 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 was qcow2, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:38 devstack sudo[110499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 Aug 19 00:21:38 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating offline snapshot b4c3db33-ec68-413d-a404-46c3a0d53fab of volume 9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c5c66-56f2-44c7-b499-1cdfeecc8af4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:38 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a Aug 19 00:21:38 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:38 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a" returned: 0 in 0.512s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:39 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab 1G Aug 19 00:21:39 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:39 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab 1G" returned: 0 in 0.779s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4c7533-48cb-4810-957f-94ccb96f037a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:39 devstack sudo[110524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4c7533-48cb-4810-957f-94ccb96f037a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab Aug 19 00:21:39 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-3e2cc95b-69b9-4eb7-9bf7-fde6ea0c5078 req-d42b8738-e7f2-467f-9d34-98de65831fd9 tempest-TestShelveInstance-1486191736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:40 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4c7533-48cb-4810-957f-94ccb96f037a -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab" returned: 0 in 0.382s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:40 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab is being set with open permissions: ugo+rw Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:40 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab Aug 19 00:21:40 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:40 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab" returned: 0 in 0.276s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:40 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info Aug 19 00:21:40 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:40 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9" returned: 0 in 2.299s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0319fa5e-ee5e-4d6a-9c2a-6d292d02f529_5yq3qnwldevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:21:40 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Converted 112.00 MB image at 48.67 MB/s Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:40 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 1G Aug 19 00:21:40 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:40 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info" returned: 0 in 0.308s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:40 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info is being set with open permissions: ugo+rw Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:40 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info Aug 19 00:21:40 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:40 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 1G" returned: 0 in 0.371s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Downloaded image 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 ((None, [{'url': 'file:///opt/stack/data/glance/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'metadata': {}}])) to volume 0ff7b18d-a4e2-46b8-b815-4913916846e9 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Temporary image 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 for user f6741633587547138ba14fbb9949cd10 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Marking volume 0ff7b18d-a4e2-46b8-b815-4913916846e9 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Copying metadata from image 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 to 0ff7b18d-a4e2-46b8-b815-4913916846e9. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:21:40 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Creating volume glance metadata for volume 0ff7b18d-a4e2-46b8-b815-4913916846e9 backed by image 0319fa5e-ee5e-4d6a-9c2a-6d292d02f529 with: {'image_id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'image_name': 'tempest-scenario-img--610309209', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:21:41 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.info" returned: 0 in 0.246s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba55b09-b8c2-481a-a86d-b3eb29999d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff7b18d-a4e2-46b8-b815-4913916846e9', 'volume_size': 1, 'image_id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--610309209', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5dbac8aaa3364722bdd99fc5e5ff2b5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0319fa5e-ee5e-4d6a-9c2a-6d292d02f529', 'created_at': datetime.datetime(2026, 8, 18, 22, 21, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 21, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0319fa5e-ee5e-4d6a-9c2a-6d292d02f529/file', 'properties': {}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d3ee70-5f0a-42fb-b7cf-430687ca211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-3e2cc95b-69b9-4eb7-9bf7-fde6ea0c5078 req-d42b8738-e7f2-467f-9d34-98de65831fd9 tempest-TestShelveInstance-1486191736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.061s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:41 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Volume volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 (0ff7b18d-a4e2-46b8-b815-4913916846e9): created successfully Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d3ee70-5f0a-42fb-b7cf-430687ca211c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Flow 'volume_create_manager' (fee469a5-a2f0-4da7-a940-d89fdeb567cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-3e2cc95b-69b9-4eb7-9bf7-fde6ea0c5078 req-d42b8738-e7f2-467f-9d34-98de65831fd9 tempest-TestShelveInstance-1486191736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d85c7c14-54d9-4d9d-9746-6f654fba571c tempest-TestInstancesWithCinderVolumes-1662922289 None] Created volume successfully. Aug 19 00:21:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-84dabe79-b751-4068-b1d8-7566fa7ee181 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Create snapshot completed successfully Aug 19 00:21:41 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-3e2cc95b-69b9-4eb7-9bf7-fde6ea0c5078 req-d42b8738-e7f2-467f-9d34-98de65831fd9 tempest-TestShelveInstance-1486191736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-de9c5f49-feb4-4420-8223-9e6ad3778de6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af754405-e19c-45b7-aa7b-e7c228e4427a', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:21:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-3e2cc95b-69b9-4eb7-9bf7-fde6ea0c5078 req-d42b8738-e7f2-467f-9d34-98de65831fd9 tempest-TestShelveInstance-1486191736 None] attachment_update completed successfully. Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (6de1701b-ffc5-405c-bcb4-dc89ac9f2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0658215a-11f9-420e-99ea-7827fc5accfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0658215a-11f9-420e-99ea-7827fc5accfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288085963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72392d80-c0f2-476f-a2f9-e35a21595e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:42Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415d0a32-117c-4fd8-bcbe-c7aef8a9368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415d0a32-117c-4fd8-bcbe-c7aef8a9368e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b111561-66e0-4f6c-9e6c-407fd636223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b111561-66e0-4f6c-9e6c-407fd636223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72392d80-c0f2-476f-a2f9-e35a21595e9f', 'volume_name': 'volume-72392d80-c0f2-476f-a2f9-e35a21595e9f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fdafdc-612f-493f-84c8-8b2f57bbfe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fdafdc-612f-493f-84c8-8b2f57bbfe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434a0c85-5657-410f-ba3a-665461748a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:42 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume 72392d80-c0f2-476f-a2f9-e35a21595e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72392d80-c0f2-476f-a2f9-e35a21595e9f', 'volume_size': 1} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-288085963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72392d80-c0f2-476f-a2f9-e35a21595e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:42Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating volume 72392d80-c0f2-476f-a2f9-e35a21595e9f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:42 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:42 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f 1073741824 Aug 19 00:21:42 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (a4eb05d2-27b3-4ead-82ac-e40536195fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:42 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3936f1d-2d42-4e2e-83e2-6d27037c25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3936f1d-2d42-4e2e-83e2-6d27037c25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183628983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f25cd6-63ce-4c38-b2bb-ab46387648f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:43Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d863cb9-9c43-4c0f-bea8-7e067d5ee932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d863cb9-9c43-4c0f-bea8-7e067d5ee932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347c750f-016c-40d2-bd3c-e8db49a986e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347c750f-016c-40d2-bd3c-e8db49a986e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f25cd6-63ce-4c38-b2bb-ab46387648f1', 'volume_name': 'volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62aef8ae-8d0b-41a4-8786-45bc79c853fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62aef8ae-8d0b-41a4-8786-45bc79c853fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f35af8c-f7cc-4ab5-bb56-0ec76d716cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume 50f25cd6-63ce-4c38-b2bb-ab46387648f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1', 'volume_size': 1} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (8b671777-2369-4d8e-8daf-ceeedd1b3d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd9d97c-1618-47f6-bd90-7792fd863562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd9d97c-1618-47f6-bd90-7792fd863562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757814343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc88ec1b-7648-4e96-a698-0a555bb851ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:43Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d97c18-d091-43ea-994d-6cb5847fc7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d97c18-d091-43ea-994d-6cb5847fc7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6b9237-d18d-466c-aa6c-e475b2d4376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6b9237-d18d-466c-aa6c-e475b2d4376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc88ec1b-7648-4e96-a698-0a555bb851ed', 'volume_name': 'volume-fc88ec1b-7648-4e96-a698-0a555bb851ed', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462efd9f-88fa-4061-8fec-881b7c64b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462efd9f-88fa-4061-8fec-881b7c64b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e4d782-8e21-432e-aff8-951fa6b2b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:43 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume fc88ec1b-7648-4e96-a698-0a555bb851ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc88ec1b-7648-4e96-a698-0a555bb851ed', 'volume_size': 1} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f 1073741824" returned: 0 in 0.923s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:43 devstack sudo[110559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f Aug 19 00:21:43 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:43 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:44 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (4ab6061f-58de-49e6-8f37-69735bf5df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258fd752-192a-4846-bd6f-95cf83206ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f" returned: 0 in 0.405s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183628983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f25cd6-63ce-4c38-b2bb-ab46387648f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:43Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating volume 50f25cd6-63ce-4c38-b2bb-ab46387648f1 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:44 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258fd752-192a-4846-bd6f-95cf83206ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865343652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:44Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4d06c0-5e29-4482-9d5a-47d4ea898412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4d06c0-5e29-4482-9d5a-47d4ea898412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c6893f-2194-4b5f-ac86-0b6b3fca749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack sudo[110566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 1073741824 Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c6893f-2194-4b5f-ac86-0b6b3fca749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae', 'volume_name': 'volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58dad3c7-4b17-4a62-b323-08d0a116aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58dad3c7-4b17-4a62-b323-08d0a116aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eefc763-b2d6-4229-84f4-8ab4bd73cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae', 'volume_size': 1} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434a0c85-5657-410f-ba3a-665461748a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72392d80-c0f2-476f-a2f9-e35a21595e9f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cb2c97-e8e9-4ef1-9ffe-580d2e49ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume volume-72392d80-c0f2-476f-a2f9-e35a21595e9f (72392d80-c0f2-476f-a2f9-e35a21595e9f): created successfully Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0cb2c97-e8e9-4ef1-9ffe-580d2e49ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (6de1701b-ffc5-405c-bcb4-dc89ac9f2c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b20f28eb-01ab-43ee-9970-55192325983c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created volume successfully. Aug 19 00:21:44 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 1073741824" returned: 0 in 0.786s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (f606fe07-97b8-43b2-8d89-502ba0182fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99913d90-3fb1-41e0-a751-afc71949f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99913d90-3fb1-41e0-a751-afc71949f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846229775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d179c14-9ce2-4a80-b449-2a6991df01fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:45Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbc6aaf-3a11-4420-95d5-6922336af50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dbc6aaf-3a11-4420-95d5-6922336af50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbba4ddd-4348-4577-a459-fa7466bcd0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbba4ddd-4348-4577-a459-fa7466bcd0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d179c14-9ce2-4a80-b449-2a6991df01fd', 'volume_name': 'volume-2d179c14-9ce2-4a80-b449-2a6991df01fd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1263b7b-d3fd-41a8-95fd-90b1904eadb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1263b7b-d3fd-41a8-95fd-90b1904eadb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e523c829-ab23-4bc6-ac06-09e96926fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume 2d179c14-9ce2-4a80-b449-2a6991df01fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d179c14-9ce2-4a80-b449-2a6991df01fd', 'volume_size': 1} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:45 devstack sudo[110572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 Aug 19 00:21:45 devstack sudo[110572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:45 devstack sudo[110572]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1" returned: 0 in 0.363s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757814343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc88ec1b-7648-4e96-a698-0a555bb851ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:43Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating volume fc88ec1b-7648-4e96-a698-0a555bb851ed {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:45 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:45 devstack sudo[110575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed 1073741824 Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f35af8c-f7cc-4ab5-bb56-0ec76d716cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:45 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f763e0c-a93c-4b54-9067-1c39a5949cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:45 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 (50f25cd6-63ce-4c38-b2bb-ab46387648f1): created successfully Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f763e0c-a93c-4b54-9067-1c39a5949cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (a4eb05d2-27b3-4ead-82ac-e40536195fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-256c38c1-1dff-4329-83e8-847c81ea87f7 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created volume successfully. Aug 19 00:21:46 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed 1073741824" returned: 0 in 1.137s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:46 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed Aug 19 00:21:46 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-77bd794d-3acb-4b83-8bb0-a98be6498182 req-5570098f-1f9e-46bd-9481-dfa5d62fe1ba tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:47 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed" returned: 0 in 0.607s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-865343652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:44Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating volume c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:47 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e4d782-8e21-432e-aff8-951fa6b2b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc88ec1b-7648-4e96-a698-0a555bb851ed', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1a780d-365e-4aca-85b5-32148a6203ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:47 devstack sudo[111030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae 1073741824 Aug 19 00:21:47 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume volume-fc88ec1b-7648-4e96-a698-0a555bb851ed (fc88ec1b-7648-4e96-a698-0a555bb851ed): created successfully Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1a780d-365e-4aca-85b5-32148a6203ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (8b671777-2369-4d8e-8daf-ceeedd1b3d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c0165d23-e956-4cc9-bc68-e8d39d9d049b tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created volume successfully. Aug 19 00:21:47 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae 1073741824" returned: 0 in 0.600s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:47 devstack sudo[111052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae Aug 19 00:21:47 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:48 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae" returned: 0 in 0.559s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.468s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846229775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d179c14-9ce2-4a80-b449-2a6991df01fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ec31376f1340a9b2d6c7168f801f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:45Z,use_quota=True,user_id='c0cde5934ff34ff8ad086a1cb52200fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Creating volume 2d179c14-9ce2-4a80-b449-2a6991df01fd {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:48 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:48 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd 1073741824 Aug 19 00:21:48 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eefc763-b2d6-4229-84f4-8ab4bd73cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caccef79-2a8d-441f-888e-c2c8017c9604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae (c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae): created successfully Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caccef79-2a8d-441f-888e-c2c8017c9604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (4ab6061f-58de-49e6-8f37-69735bf5df2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-019f9a18-cc65-4d0a-a05b-022f509563c9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created volume successfully. Aug 19 00:21:49 devstack sudo[111067]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd 1073741824" returned: 0 in 0.704s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:49 devstack sudo[111075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd Aug 19 00:21:49 devstack sudo[111075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:49 devstack sudo[111075]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd" returned: 0 in 0.676s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:21:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-77bd794d-3acb-4b83-8bb0-a98be6498182 req-5570098f-1f9e-46bd-9481-dfa5d62fe1ba tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.938s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e523c829-ab23-4bc6-ac06-09e96926fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d179c14-9ce2-4a80-b449-2a6991df01fd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fb69d9-29fe-4503-9ec9-e59f26c87ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-77bd794d-3acb-4b83-8bb0-a98be6498182 req-5570098f-1f9e-46bd-9481-dfa5d62fe1ba tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Volume volume-2d179c14-9ce2-4a80-b449-2a6991df01fd (2d179c14-9ce2-4a80-b449-2a6991df01fd): created successfully Aug 19 00:21:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fb69d9-29fe-4503-9ec9-e59f26c87ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Flow 'volume_create_manager' (f606fe07-97b8-43b2-8d89-502ba0182fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-05e709e4-21e8-42ab-b865-bbb45c13916f tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created volume successfully. Aug 19 00:21:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-77bd794d-3acb-4b83-8bb0-a98be6498182 req-5570098f-1f9e-46bd-9481-dfa5d62fe1ba tempest-TestInstancesWithCinderVolumes-1662922289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-0ff7b18d-a4e2-46b8-b815-4913916846e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46f7ddd4-6338-47d1-8d8d-773ecc6cc01f', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:21:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-77bd794d-3acb-4b83-8bb0-a98be6498182 req-5570098f-1f9e-46bd-9481-dfa5d62fe1ba tempest-TestInstancesWithCinderVolumes-1662922289 None] attachment_update completed successfully. Aug 19 00:21:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-2d179c14-9ce2-4a80-b449-2a6991df01fd-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-2d179c14-9ce2-4a80-b449-2a6991df01fd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-2d179c14-9ce2-4a80-b449-2a6991df01fd" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-2d179c14-9ce2-4a80-b449-2a6991df01fd" acquired by "delete_volume" :: waited 0.044s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[924fde6e-0a40-4bfc-970e-5c8dcc19ab60]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:51 devstack sudo[111080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd Aug 19 00:21:51 devstack sudo[111080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:52 devstack sudo[111080]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd" returned: 0 in 0.691s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:52 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd Aug 19 00:21:52 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:52 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d179c14-9ce2-4a80-b449-2a6991df01fd" returned: 0 in 0.492s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-2d179c14-9ce2-4a80-b449-2a6991df01fd" released by "delete_volume" :: held 1.313s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['9a87c1d2-79c0-450c-8081-00f3741ae6fd', 'f396efb2-63da-43b8-a8cb-2e107927d442', 'ea115c77-e77e-4614-9a6c-51ff5d8e195d', '47af3425-6025-4e59-b338-9926c2053e00'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:53 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:21:53 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:53 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.796s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleted volume successfully. Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-aea7d373-c400-493a-a5b6-a5f37f6c69c3 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-2d179c14-9ce2-4a80-b449-2a6991df01fd-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35b9242-da67-437f-a788-9bc0176936cf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:54 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae Aug 19 00:21:54 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:54 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae" returned: 0 in 0.614s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:54 devstack sudo[111172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae Aug 19 00:21:54 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:55 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae" returned: 0 in 0.405s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae" released by "delete_volume" :: held 1.118s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['5372caeb-512d-486c-bde6-95d43bfab223', 'ced266fb-ea95-42c1-a8e4-98e7bcd502d4', '7610b83f-d4eb-46b4-b6b4-bf6ba2e874d8', '2a2e3225-6131-4f5f-bbeb-6212f351be1e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:55 devstack sudo[111183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:21:55 devstack sudo[111183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:55 devstack sudo[111183]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.294s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:21:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleted volume successfully. Aug 19 00:21:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-94ef7214-b9d4-4882-b98d-f3bee1ac985c tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-c9bc2c1f-cc85-4daa-8a74-bbe30bfcbfae-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-fc88ec1b-7648-4e96-a698-0a555bb851ed-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-fc88ec1b-7648-4e96-a698-0a555bb851ed-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-fc88ec1b-7648-4e96-a698-0a555bb851ed" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-fc88ec1b-7648-4e96-a698-0a555bb851ed" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1db90c6-d605-412c-bb73-9ee169ea0e55]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:56 devstack sudo[111188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed Aug 19 00:21:56 devstack sudo[111188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:56 devstack sudo[111188]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed" returned: 0 in 0.664s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:57 devstack sudo[111193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed Aug 19 00:21:57 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:57 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fc88ec1b-7648-4e96-a698-0a555bb851ed" returned: 0 in 0.333s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-fc88ec1b-7648-4e96-a698-0a555bb851ed" released by "delete_volume" :: held 1.100s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['77650b66-1ecd-4ec2-bacd-f15e91696a81', '79f63379-bdad-46f5-beaa-f9f1e36f05e5', '0bb9aac3-f7c7-45df-a184-1d5a60a7b66e', 'fd2ce42d-cb5d-4daa-947d-254e29685b06'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:57 devstack sudo[111196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:21:57 devstack sudo[111196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:58 devstack sudo[111196]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.455s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:21:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleted volume successfully. Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-dc0c8ef9-a9c7-4f2a-89e6-5b5211f69aa9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-fc88ec1b-7648-4e96-a698-0a555bb851ed-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (f48c5ea9-b856-4936-97f4-16c14cc7af58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976fedc6-6c42-4969-90c0-b154bb5fb0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976fedc6-6c42-4969-90c0-b154bb5fb0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938693767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34597906-dd35-41ad-99fc-82961a45be60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:58Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f218c3-c59f-4072-84bd-4c20c486a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f218c3-c59f-4072-84bd-4c20c486a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1141613b-1ced-4a14-a96f-38fe3ec99889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1141613b-1ced-4a14-a96f-38fe3ec99889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34597906-dd35-41ad-99fc-82961a45be60', 'volume_name': 'volume-34597906-dd35-41ad-99fc-82961a45be60', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f75bd32-61ed-491d-9d57-52996a9248dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f75bd32-61ed-491d-9d57-52996a9248dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b25935f-40c4-4e9a-91e8-02756d0b3488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:58 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Volume 34597906-dd35-41ad-99fc-82961a45be60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34597906-dd35-41ad-99fc-82961a45be60', 'volume_size': 1} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938693767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34597906-dd35-41ad-99fc-82961a45be60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:58Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Creating volume 34597906-dd35-41ad-99fc-82961a45be60 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:21:58 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:58 devstack sudo[111199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 1073741824 Aug 19 00:21:58 devstack sudo[111199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-50f25cd6-63ce-4c38-b2bb-ab46387648f1-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-50f25cd6-63ce-4c38-b2bb-ab46387648f1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-50f25cd6-63ce-4c38-b2bb-ab46387648f1" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:21:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-50f25cd6-63ce-4c38-b2bb-ab46387648f1" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd3ef3b-593f-4e46-a300-29a513ad33af]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (faa96ada-86ee-457a-9276-088f2855f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d53a89-f5f4-4cbf-99f6-2313344c781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d53a89-f5f4-4cbf-99f6-2313344c781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1581213581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895672f4-d4b4-4ebd-b510-58c11118756b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:59Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b953d556-88d3-4148-bad7-ef1f2ab4bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b953d556-88d3-4148-bad7-ef1f2ab4bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb95c3-b876-4dcc-8a90-5c5d8fea6b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb95c3-b876-4dcc-8a90-5c5d8fea6b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895672f4-d4b4-4ebd-b510-58c11118756b', 'volume_name': 'volume-895672f4-d4b4-4ebd-b510-58c11118756b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ca6653-3c00-4a51-a66a-6f30717cf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ca6653-3c00-4a51-a66a-6f30717cf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2545812-7db1-458a-955e-dfd49aeaab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:21:59 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 Aug 19 00:21:59 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Volume 895672f4-d4b4-4ebd-b510-58c11118756b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895672f4-d4b4-4ebd-b510-58c11118756b', 'volume_size': 1} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:21:59 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:21:59 devstack sudo[111199]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 1073741824" returned: 0 in 1.144s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:59 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1" returned: 0 in 0.845s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:21:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:21:59 devstack sudo[111211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 Aug 19 00:21:59 devstack sudo[111211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:00 devstack sudo[111213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1 Aug 19 00:22:00 devstack sudo[111213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (70691565-cd1a-4e6f-aa75-9dd8e80a48b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b28c64-af48-4aa8-ac40-3f57e4d3d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:00 devstack sudo[111211]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60" returned: 0 in 0.554s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1581213581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895672f4-d4b4-4ebd-b510-58c11118756b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:21:59Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Creating volume 895672f4-d4b4-4ebd-b510-58c11118756b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:00 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b28c64-af48-4aa8-ac40-3f57e4d3d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425739020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcff0d7-fe9f-41c7-b592-1b36ef71edbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:00Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:00 devstack sudo[111216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b 1073741824 Aug 19 00:22:00 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39473fbb-7b2a-4d8c-94a8-35a00baa8627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39473fbb-7b2a-4d8c-94a8-35a00baa8627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0c8f6e-7635-428e-b93d-be3551c11af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0c8f6e-7635-428e-b93d-be3551c11af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcff0d7-fe9f-41c7-b592-1b36ef71edbf', 'volume_name': 'volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67451a9-f106-4e9f-894a-d681449864c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67451a9-f106-4e9f-894a-d681449864c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e5ae3a-e588-4d00-b9ad-76c56b4bb809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:00 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Volume 0bcff0d7-fe9f-41c7-b592-1b36ef71edbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf', 'volume_size': 1} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b25935f-40c4-4e9a-91e8-02756d0b3488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34597906-dd35-41ad-99fc-82961a45be60', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e30ad98-41e0-459a-8ae4-9dad3eca56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:00 devstack sudo[111213]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-50f25cd6-63ce-4c38-b2bb-ab46387648f1" returned: 0 in 0.702s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:00 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Volume volume-34597906-dd35-41ad-99fc-82961a45be60 (34597906-dd35-41ad-99fc-82961a45be60): created successfully Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e30ad98-41e0-459a-8ae4-9dad3eca56fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (f48c5ea9-b856-4936-97f4-16c14cc7af58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-72228ec0-6ff8-48b3-b74a-d0cfe350f88e tempest-CreateVolumesFromImageTest-1029386700 None] Created volume successfully. Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-50f25cd6-63ce-4c38-b2bb-ab46387648f1" released by "delete_volume" :: held 1.749s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:00 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['c7716b57-ecc0-4536-bec2-bb83d9febfc4', '1b500c78-42a4-418c-a493-dba52ea564f4', '28b3fabe-2dbe-4cd7-846b-b0fee1639fbf', 'f5e68bd6-0e6e-4818-b4ab-95342b54f5cb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:01 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:01 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (c4716be7-e3f2-4a50-b561-552181beace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6e3a02-f73e-4b86-9ab0-c23cac483d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6e3a02-f73e-4b86-9ab0-c23cac483d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786892648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b373971-e991-4d89-854e-939bced17006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:01Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:01 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d49de2d-2004-4d62-97de-279cc9d93518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d49de2d-2004-4d62-97de-279cc9d93518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33bdd05-807f-4aa1-b7e0-dbb70d6c7511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33bdd05-807f-4aa1-b7e0-dbb70d6c7511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b373971-e991-4d89-854e-939bced17006', 'volume_name': 'volume-7b373971-e991-4d89-854e-939bced17006', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7329ba-17f8-4f92-9fa3-2ded1329e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:01 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7329ba-17f8-4f92-9fa3-2ded1329e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facfa099-fc52-4742-98aa-cc8884bb929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:01 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Volume 7b373971-e991-4d89-854e-939bced17006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b373971-e991-4d89-854e-939bced17006', 'volume_size': 1} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-72392d80-c0f2-476f-a2f9-e35a21595e9f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b 1073741824" returned: 0 in 1.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.633s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:01 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleted volume successfully. Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-72392d80-c0f2-476f-a2f9-e35a21595e9f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a585ece3-d2be-4512-82a6-b73be0953696 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-50f25cd6-63ce-4c38-b2bb-ab46387648f1-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:01 devstack sudo[111226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b Aug 19 00:22:01 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-72392d80-c0f2-476f-a2f9-e35a21595e9f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-72392d80-c0f2-476f-a2f9-e35a21595e9f" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[970282ae-1de4-4916-96ee-2ddb0b0358a0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:02 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f Aug 19 00:22:02 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (4766ba41-a8db-4dbd-9944-1ddd8fda9871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a178f8d1-ee09-49b8-9499-2bef281767e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a178f8d1-ee09-49b8-9499-2bef281767e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1313112628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebe9958-c420-442b-ae5a-f6c3359e7488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:02Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e20dfb-0dd6-444f-9a32-b2099e9422cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e20dfb-0dd6-444f-9a32-b2099e9422cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:02 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce64346-8baa-4e4f-a91b-ee21dab173ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce64346-8baa-4e4f-a91b-ee21dab173ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebe9958-c420-442b-ae5a-f6c3359e7488', 'volume_name': 'volume-2ebe9958-c420-442b-ae5a-f6c3359e7488', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2538313-3d22-49d1-b1aa-21b8e67038b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2538313-3d22-49d1-b1aa-21b8e67038b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed8aaeb-2b7f-43a0-b572-70877024cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Volume 2ebe9958-c420-442b-ae5a-f6c3359e7488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebe9958-c420-442b-ae5a-f6c3359e7488', 'volume_size': 1} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b" returned: 0 in 0.864s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] <== create_volume: return (2263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425739020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcff0d7-fe9f-41c7-b592-1b36ef71edbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:00Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Creating volume 0bcff0d7-fe9f-41c7-b592-1b36ef71edbf {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:02 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2545812-7db1-458a-955e-dfd49aeaab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895672f4-d4b4-4ebd-b510-58c11118756b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d703f0d-12b5-4a06-9ac3-812372b5f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:02 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f" returned: 0 in 0.779s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:02 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf 1073741824 Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:02 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Volume volume-895672f4-d4b4-4ebd-b510-58c11118756b (895672f4-d4b4-4ebd-b510-58c11118756b): created successfully Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d703f0d-12b5-4a06-9ac3-812372b5f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:02 devstack sudo[111237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f Aug 19 00:22:02 devstack sudo[111237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (faa96ada-86ee-457a-9276-088f2855f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-65894544-ebd5-40d1-82c2-36517e1f576f tempest-CreateVolumesFromImageTest-1029386700 None] Created volume successfully. Aug 19 00:22:03 devstack sudo[111237]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-72392d80-c0f2-476f-a2f9-e35a21595e9f" returned: 0 in 0.628s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-72392d80-c0f2-476f-a2f9-e35a21595e9f" released by "delete_volume" :: held 1.475s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['e974cfd7-392e-4d5c-870a-194c01addbd2', '15e2a1bd-6c68-403b-89d0-d52dc68a2352', '4b381c27-13ea-488b-8ff4-071d368d448e', '44580635-3086-4ae5-801d-70482bfdf15d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:03 devstack sudo[111244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:03 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:03 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf 1073741824" returned: 0 in 1.145s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:03 devstack sudo[111246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf Aug 19 00:22:03 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:04 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.434s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleted volume successfully. Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5eb9f3ae-e8f1-4324-b39c-0c579bb7a576 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-72392d80-c0f2-476f-a2f9-e35a21595e9f-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:04 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.560s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786892648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b373971-e991-4d89-854e-939bced17006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:01Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Creating volume 7b373971-e991-4d89-854e-939bced17006 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:04 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-b4c3db33-ec68-413d-a404-46c3a0d53fab-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:04 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 1073741824 Aug 19 00:22:04 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e5ae3a-e588-4d00-b9ad-76c56b4bb809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fdd9a2-f372-40fe-8247-96278c8b45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-b4c3db33-ec68-413d-a404-46c3a0d53fab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-9e4c7533-48cb-4810-957f-94ccb96f037a" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:04 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Volume volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf (0bcff0d7-fe9f-41c7-b592-1b36ef71edbf): created successfully Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fdd9a2-f372-40fe-8247-96278c8b45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (70691565-cd1a-4e6f-aa75-9dd8e80a48b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-9e4c7533-48cb-4810-957f-94ccb96f037a" acquired by "delete_snapshot" :: waited 0.099s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-b4c3db33-ec68-413d-a404-46c3a0d53fab" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ebe17639-ef6f-4872-985a-b3d45dfbfd85 tempest-CreateVolumesFromImageTest-1029386700 None] Created volume successfully. Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-b4c3db33-ec68-413d-a404-46c3a0d53fab" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleting offline snapshot b4c3db33-ec68-413d-a404-46c3a0d53fab of volume 9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] snapshot_file for this snap is: volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca8a0c5-23e9-4d48-9c77-e3889b0d2ab4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:04 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab Aug 19 00:22:04 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:05 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 1073741824" returned: 0 in 0.880s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:05 devstack sudo[111258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 Aug 19 00:22:05 devstack sudo[111258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:05 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab" returned: 0 in 0.735s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e4c7533-48cb-4810-957f-94ccb96f037a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7043f608-c6f1-41e7-b608-86ef89b4d581]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:05 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a Aug 19 00:22:05 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:05 devstack sudo[111258]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006" returned: 0 in 0.536s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.131s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1313112628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebe9958-c420-442b-ae5a-f6c3359e7488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b79febb81548b6b8080d87fa015eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:02Z,use_quota=True,user_id='83c9b75751b8411fa046ddc358cfc900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Creating volume 2ebe9958-c420-442b-ae5a-f6c3359e7488 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:05 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (facfa099-fc52-4742-98aa-cc8884bb929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b373971-e991-4d89-854e-939bced17006', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:05 devstack sudo[111290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 1073741824 Aug 19 00:22:05 devstack sudo[111290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6291d4b-6e61-4963-99dc-83a9164bb558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:05 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Volume volume-7b373971-e991-4d89-854e-939bced17006 (7b373971-e991-4d89-854e-939bced17006): created successfully Aug 19 00:22:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6291d4b-6e61-4963-99dc-83a9164bb558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (c4716be7-e3f2-4a50-b561-552181beace7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:06 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6b8cedec-b103-41f6-ac19-4c3c15a22719 tempest-CreateVolumesFromImageTest-1029386700 None] Created volume successfully. Aug 19 00:22:06 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a" returned: 0 in 0.707s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:06 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab Aug 19 00:22:06 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:06 devstack sudo[111290]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 1073741824" returned: 0 in 0.805s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:06 devstack sudo[111306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 Aug 19 00:22:06 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:06 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab" returned: 0 in 0.591s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:06 devstack sudo[111308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab Aug 19 00:22:06 devstack sudo[111308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:07 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488" returned: 0 in 0.540s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed8aaeb-2b7f-43a0-b572-70877024cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebe9958-c420-442b-ae5a-f6c3359e7488', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08aa8a78-0f36-4ba4-9f10-8db6e6848914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:07 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Volume volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 (2ebe9958-c420-442b-ae5a-f6c3359e7488): created successfully Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08aa8a78-0f36-4ba4-9f10-8db6e6848914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Flow 'volume_create_manager' (4766ba41-a8db-4dbd-9944-1ddd8fda9871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:07 devstack sudo[111308]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a.b4c3db33-ec68-413d-a404-46c3a0d53fab" returned: 0 in 0.650s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a42158c9-46b4-4986-94e2-5a6153af2dcf tempest-CreateVolumesFromImageTest-1029386700 None] Created volume successfully. Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-b4c3db33-ec68-413d-a404-46c3a0d53fab" released by "_delete_snapshot" :: held 2.905s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-9e4c7533-48cb-4810-957f-94ccb96f037a" released by "delete_snapshot" :: held 2.995s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['0a7a13b9-d33b-49cc-9164-a43c4821db13', '8813a7a9-0929-4abe-9d7a-ae88d481aa52', 'b3023ed9-476f-4cbd-9534-09a0f67429b8', 'd0c91822-317e-4357-b743-b2e704ba4d6f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Delete snapshot completed successfully. Aug 19 00:22:07 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-16be8190-f09b-4a2c-9d55-de6088df56b9 tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-b4c3db33-ec68-413d-a404-46c3a0d53fab-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-2ebe9958-c420-442b-ae5a-f6c3359e7488-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-2ebe9958-c420-442b-ae5a-f6c3359e7488-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-quobyte-2ebe9958-c420-442b-ae5a-f6c3359e7488" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-2ebe9958-c420-442b-ae5a-f6c3359e7488" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fbab68-fb9f-4659-b42f-a537bb98b41c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:08 devstack sudo[111322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 Aug 19 00:22:08 devstack sudo[111322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-9e4c7533-48cb-4810-957f-94ccb96f037a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-9e4c7533-48cb-4810-957f-94ccb96f037a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "cinder-quobyte-9e4c7533-48cb-4810-957f-94ccb96f037a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-9e4c7533-48cb-4810-957f-94ccb96f037a" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b5911e-8e7a-45a9-9fd6-bbd569744980]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:09 devstack sudo[111322]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488" returned: 0 in 0.647s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:09 devstack sudo[111329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488 Aug 19 00:22:09 devstack sudo[111329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:09 devstack sudo[111324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a Aug 19 00:22:09 devstack sudo[111324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:09 devstack sudo[111324]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a" returned: 0 in 0.626s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:09 devstack sudo[111329]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2ebe9958-c420-442b-ae5a-f6c3359e7488" returned: 0 in 0.442s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:09 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a Aug 19 00:22:09 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-2ebe9958-c420-442b-ae5a-f6c3359e7488" released by "delete_volume" :: held 1.136s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Created reservations ['a5a7e1ae-986f-4ea6-a12b-8314731fbfed', '81342daf-7f8c-4907-aad4-29520f0c3275', 'ceb36214-5a86-4aba-8c54-c7aa6a8979d6', 'e3249d1a-3725-41b0-b724-e336fe4ff60e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:09 devstack sudo[111338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:09 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:09 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9e4c7533-48cb-4810-957f-94ccb96f037a" returned: 0 in 0.316s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-quobyte-9e4c7533-48cb-4810-957f-94ccb96f037a" released by "delete_volume" :: held 1.019s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:09 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Created reservations ['ea1d70c0-155a-40c3-86b3-eb3fa4feeaef', '450d1e47-63f6-42bb-a3c9-ab035c0cbdfb', '78832017-125e-43b6-a07c-e20209c1d513', '11b77bf7-c6ac-4b74-af3e-aa0c5413c685'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:10 devstack sudo[111341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:10 devstack sudo[111341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:10 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.308s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Deleted volume successfully. Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6aac6743-931a-4636-bfd3-b2af15ba2dc3 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-2ebe9958-c420-442b-ae5a-f6c3359e7488-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:10 devstack sudo[111341]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Deleted volume successfully. Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbef4add-eab2-4071-9a7b-d5670442e0ef tempest-CreateVolumesFromSnapshotTest-1194218534 None] Lock "cinder-9e4c7533-48cb-4810-957f-94ccb96f037a-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-7b373971-e991-4d89-854e-939bced17006-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-7b373971-e991-4d89-854e-939bced17006-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-quobyte-7b373971-e991-4d89-854e-939bced17006" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-7b373971-e991-4d89-854e-939bced17006" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e10d0-13e2-43ed-8f02-a491f823e627]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:10 devstack sudo[111345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 Aug 19 00:22:10 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:11 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006" returned: 0 in 0.391s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:11 devstack sudo[111350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006 Aug 19 00:22:11 devstack sudo[111350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:11 devstack sudo[111350]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7b373971-e991-4d89-854e-939bced17006" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-7b373971-e991-4d89-854e-939bced17006" released by "delete_volume" :: held 0.722s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Created reservations ['7c9d5d9a-1a61-4f51-8f85-5584c8bfa44b', '7b3176a3-9b52-4bdd-a850-3f56665274ce', '10d11bf6-05ae-4534-8de4-ada3b7b56ff9', '99bb7923-5dee-431b-a4ee-037a00d91ef3'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:11 devstack sudo[111354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:11 devstack sudo[111354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:11 devstack sudo[111354]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.326s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Deleted volume successfully. Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e7aec296-060d-4170-8966-cdbbf3fb0128 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-7b373971-e991-4d89-854e-939bced17006-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-quobyte-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364e3f9-7230-447f-986e-4adf5d346b58]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:12 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf Aug 19 00:22:12 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:12 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:12 devstack sudo[111362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf Aug 19 00:22:12 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:12 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf" returned: 0 in 0.264s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf" released by "delete_volume" :: held 0.728s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Created reservations ['0323c2c8-d519-4322-b2f9-7051db871232', '803cade3-dd9a-47f1-b11b-2a4b83b900e1', 'a667fbc7-6e85-4b04-b420-9430f7ece9b4', '3d177fde-47ee-4363-af33-57ed2c91eee5'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:12 devstack sudo[111365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:12 devstack sudo[111365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-895672f4-d4b4-4ebd-b510-58c11118756b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-895672f4-d4b4-4ebd-b510-58c11118756b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:13 devstack sudo[111365]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.346s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-quobyte-895672f4-d4b4-4ebd-b510-58c11118756b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Deleted volume successfully. Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-44557724-49fe-4c7e-81fc-29e81fb04962 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-0bcff0d7-fe9f-41c7-b592-1b36ef71edbf-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-895672f4-d4b4-4ebd-b510-58c11118756b" acquired by "delete_volume" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4dff4-43d9-4e1f-84a4-e2ddaf55e4b6]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:13 devstack sudo[111369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:13 devstack sudo[111369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:13 devstack sudo[111368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b Aug 19 00:22:13 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:13 devstack sudo[111369]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:22:13 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b" returned: 0 in 0.464s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:13 devstack sudo[111376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b Aug 19 00:22:13 devstack sudo[111376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:14 devstack sudo[111376]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-895672f4-d4b4-4ebd-b510-58c11118756b" returned: 0 in 0.275s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-895672f4-d4b4-4ebd-b510-58c11118756b" released by "delete_volume" :: held 0.787s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Created reservations ['bb92f702-0aea-44df-bc40-b71946e3c795', '50c2e23c-f63e-4e00-b1e6-a548a68a766a', '15883a51-6ea6-41fa-affc-62c850e8c1e9', '2bdc111d-251e-4a5c-b2c6-d89c26ae555e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:14 devstack sudo[111379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:14 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-34597906-dd35-41ad-99fc-82961a45be60-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-34597906-dd35-41ad-99fc-82961a45be60-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "cinder-quobyte-34597906-dd35-41ad-99fc-82961a45be60" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Flow 'volume_create_manager' (52750f11-d3db-49fe-a8ed-1e9f5d42520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3b78a5-b2f7-4814-bdd5-6b94a809aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-34597906-dd35-41ad-99fc-82961a45be60" acquired by "delete_volume" :: waited 0.096s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3b78a5-b2f7-4814-bdd5-6b94a809aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9697c5-76e3-4174-bdee-df4f27e9670f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9911225d2a642d8b08777f0e1b50ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:15Z,use_quota=True,user_id='a12a9636e4334e21a559440c24c5a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d8741d-297e-4744-9b28-1865bedd8306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d8741d-297e-4744-9b28-1865bedd8306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:14 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70c8902-cceb-4d58-b6ed-2af04f07148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70c8902-cceb-4d58-b6ed-2af04f07148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9697c5-76e3-4174-bdee-df4f27e9670f', 'volume_name': 'volume-6f9697c5-76e3-4174-bdee-df4f27e9670f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04277a08-5427-49fa-b20a-ebdb9b03a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04277a08-5427-49fa-b20a-ebdb9b03a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f1f417-4f9e-44af-b5f9-6ab11a0fea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Volume 6f9697c5-76e3-4174-bdee-df4f27e9670f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9697c5-76e3-4174-bdee-df4f27e9670f', 'volume_size': 1} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9697c5-76e3-4174-bdee-df4f27e9670f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9911225d2a642d8b08777f0e1b50ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:15Z,use_quota=True,user_id='a12a9636e4334e21a559440c24c5a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Creating volume 6f9697c5-76e3-4174-bdee-df4f27e9670f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:14 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ff0db-0dec-4050-b409-63c168c3eede]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.562s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:14 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f 1073741824 Aug 19 00:22:14 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:14 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Deleted volume successfully. Aug 19 00:22:14 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0e519c86-7a23-424b-a1a6-e35ea9dcaabf tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-895672f4-d4b4-4ebd-b510-58c11118756b-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:14 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 Aug 19 00:22:14 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:15 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f 1073741824" returned: 0 in 0.611s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:15 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60" returned: 0 in 0.660s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:15 devstack sudo[111429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f Aug 19 00:22:15 devstack sudo[111429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:15 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60 Aug 19 00:22:15 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:15 devstack sudo[111429]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f" returned: 0 in 0.339s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f1f417-4f9e-44af-b5f9-6ab11a0fea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9697c5-76e3-4174-bdee-df4f27e9670f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03d55eb-6e23-4a4c-92a7-cf0cfc3c159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Volume volume-6f9697c5-76e3-4174-bdee-df4f27e9670f (6f9697c5-76e3-4174-bdee-df4f27e9670f): created successfully Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03d55eb-6e23-4a4c-92a7-cf0cfc3c159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Flow 'volume_create_manager' (52750f11-d3db-49fe-a8ed-1e9f5d42520d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:15 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34597906-dd35-41ad-99fc-82961a45be60" returned: 0 in 0.396s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-quobyte-34597906-dd35-41ad-99fc-82961a45be60" released by "delete_volume" :: held 1.232s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e8829426-0ef5-43bc-bf65-7ef2127b6285 tempest-CinderUnicodeTest-1066944777 None] Created volume successfully. Aug 19 00:22:15 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Created reservations ['657a8ca5-6a19-4be4-ae72-6ee48e155e55', '376675c2-1f0c-4cfd-ba97-82a688c61a5c', '4d777e9e-8bde-4349-96f1-cd495e27d3ac', '08f10420-a031-448c-bebb-423fd6172669'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:16 devstack sudo[111435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:16 devstack sudo[111435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:16 devstack sudo[111435]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.291s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Deleted volume successfully. Aug 19 00:22:16 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-83a46b16-7c8a-4b4c-9231-b3bd7fefc553 tempest-CreateVolumesFromImageTest-1029386700 None] Lock "cinder-34597906-dd35-41ad-99fc-82961a45be60-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Flow 'volume_create_manager' (4f13f042-4310-41bf-a580-42d1d3532be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6680b08-a2f6-41ea-a0f5-4a104922ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6680b08-a2f6-41ea-a0f5-4a104922ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-371420789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edecc25-de01-4b1e-924c-b0f0d57346c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9911225d2a642d8b08777f0e1b50ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:17Z,use_quota=True,user_id='a12a9636e4334e21a559440c24c5a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a9d6ac-d2b9-4a1a-974f-07a978d3fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a9d6ac-d2b9-4a1a-974f-07a978d3fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140632e9-0d40-4121-a22c-b106034a37ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140632e9-0d40-4121-a22c-b106034a37ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2edecc25-de01-4b1e-924c-b0f0d57346c8', 'volume_name': 'volume-2edecc25-de01-4b1e-924c-b0f0d57346c8', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4a5882-9bc0-47c8-9933-8462674b6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4a5882-9bc0-47c8-9933-8462674b6f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4603b2f-37a2-4f13-9ab8-f68e530b8804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Volume 2edecc25-de01-4b1e-924c-b0f0d57346c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2edecc25-de01-4b1e-924c-b0f0d57346c8', 'volume_size': 1} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-371420789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edecc25-de01-4b1e-924c-b0f0d57346c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9911225d2a642d8b08777f0e1b50ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:17Z,use_quota=True,user_id='a12a9636e4334e21a559440c24c5a3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Creating volume 2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:17 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:17 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 1073741824 Aug 19 00:22:17 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:17 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 1073741824" returned: 0 in 0.462s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:17 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 Aug 19 00:22:17 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:17 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8" returned: 0 in 0.273s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4603b2f-37a2-4f13-9ab8-f68e530b8804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edecc25-de01-4b1e-924c-b0f0d57346c8', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eca6768-3761-4de2-866d-d92f0d3a144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Volume volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 (2edecc25-de01-4b1e-924c-b0f0d57346c8): created successfully Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eca6768-3761-4de2-866d-d92f0d3a144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Flow 'volume_create_manager' (4f13f042-4310-41bf-a580-42d1d3532be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:18 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-eb7f117b-e1a9-4392-9356-fa0c7dc0f8a8 tempest-CinderUnicodeTest-1066944777 None] Created volume successfully. Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Creating offline snapshot 560dacd2-a3a1-4219-b8d5-4fd786dcfec1 of volume 2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd7f5a-9e95-4246-aa18-91e942b0d0ff]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:19 devstack sudo[111448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 Aug 19 00:22:19 devstack sudo[111448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Flow 'volume_create_manager' (c86133a6-042f-4798-a5fd-b7baa2203aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea19c697-85d4-403d-8bcd-fc982edc9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea19c697-85d4-403d-8bcd-fc982edc9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1418852551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92f92a4-7fc3-4b26-a098-c4d5da642e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612b62172b9e40e8a3119a350395a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:20Z,use_quota=True,user_id='4e57dc13ce73428fbc9ced68e23ea3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efce8b7e-e27e-4a0f-bfe8-dce65d62cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efce8b7e-e27e-4a0f-bfe8-dce65d62cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928a63b1-eb0c-4474-b23d-5b0b17cc5c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928a63b1-eb0c-4474-b23d-5b0b17cc5c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92f92a4-7fc3-4b26-a098-c4d5da642e8e', 'volume_name': 'volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9b80a9-b95a-4045-9471-63378b5b81d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9b80a9-b95a-4045-9471-63378b5b81d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c7b0aa-33c8-4f13-9f58-1bb076a1cdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Volume c92f92a4-7fc3-4b26-a098-c4d5da642e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e', 'volume_size': 1} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:19 devstack sudo[111448]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8" returned: 0 in 0.382s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:19 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 1G Aug 19 00:22:19 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:20 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 1G" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:20 devstack sudo[111459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 Aug 19 00:22:20 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:20 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1" returned: 0 in 0.291s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:20 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 is being set with open permissions: ugo+rw Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:20 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 Aug 19 00:22:20 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:20 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:20 devstack sudo[111467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info Aug 19 00:22:20 devstack sudo[111467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:20 devstack sudo[111467]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info" returned: 0 in 0.244s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:20 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info is being set with open permissions: ugo+rw Aug 19 00:22:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:21 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info Aug 19 00:22:21 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:21 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.info" returned: 0 in 0.239s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1418852551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92f92a4-7fc3-4b26-a098-c4d5da642e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612b62172b9e40e8a3119a350395a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:20Z,use_quota=True,user_id='4e57dc13ce73428fbc9ced68e23ea3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Creating volume c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:21 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:21 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e 1073741824 Aug 19 00:22:21 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4afd914a-13b4-4d2f-8a0c-8071658c8513 tempest-CinderUnicodeTest-1066944777 None] Create snapshot completed successfully Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-560dacd2-a3a1-4219-b8d5-4fd786dcfec1-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-560dacd2-a3a1-4219-b8d5-4fd786dcfec1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-quobyte-2edecc25-de01-4b1e-924c-b0f0d57346c8" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-2edecc25-de01-4b1e-924c-b0f0d57346c8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-quobyte-560dacd2-a3a1-4219-b8d5-4fd786dcfec1" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-560dacd2-a3a1-4219-b8d5-4fd786dcfec1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Deleting offline snapshot 560dacd2-a3a1-4219-b8d5-4fd786dcfec1 of volume 2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] snapshot_file for this snap is: volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc6d2e-0f9f-436f-b631-b227a5283a72]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:21 devstack sudo[111479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 Aug 19 00:22:21 devstack sudo[111479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:21 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e 1073741824" returned: 0 in 0.502s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:21 devstack sudo[111481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e Aug 19 00:22:21 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:22 devstack sudo[111479]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1" returned: 0 in 0.448s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2edecc25-de01-4b1e-924c-b0f0d57346c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf40d7-131a-41e7-b536-a8dac8ca26cf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:22 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c7b0aa-33c8-4f13-9f58-1bb076a1cdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8ca071-d74c-4252-b13d-7c15e96e79ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:22 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Volume volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e (c92f92a4-7fc3-4b26-a098-c4d5da642e8e): created successfully Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8ca071-d74c-4252-b13d-7c15e96e79ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Flow 'volume_create_manager' (c86133a6-042f-4798-a5fd-b7baa2203aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b74d14a8-8a67-44d6-a557-f2cafedae823 tempest-VolumeDependencyTests-1365618473 None] Created volume successfully. Aug 19 00:22:22 devstack sudo[111488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 Aug 19 00:22:22 devstack sudo[111488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:22 devstack sudo[111488]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:22 devstack sudo[111493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 Aug 19 00:22:22 devstack sudo[111493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:22 devstack sudo[111493]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1" returned: 0 in 0.384s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:22 devstack sudo[111499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1 Aug 19 00:22:22 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Creating offline snapshot efe1b083-6e95-4216-aa81-6ca512bc5ddb of volume c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5bc539-a7a4-4e6d-87d2-fca1d1177450]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:23 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8.560dacd2-a3a1-4219-b8d5-4fd786dcfec1" returned: 0 in 0.297s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:23 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e Aug 19 00:22:23 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-560dacd2-a3a1-4219-b8d5-4fd786dcfec1" released by "_delete_snapshot" :: held 1.668s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-2edecc25-de01-4b1e-924c-b0f0d57346c8" released by "delete_snapshot" :: held 1.694s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Created reservations ['19152e98-c2c1-4192-9b57-3ec753553e35', '24c8b853-5457-4a2f-b8bc-2ca3344cad3e', 'd13cb6a3-5bf8-48d8-95cd-a899290ca752', '14711e84-916f-4ea7-8999-325763d9f9ce'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Delete snapshot completed successfully. Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-803b14a5-c466-4ca1-ba60-67f873cbe34c tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-560dacd2-a3a1-4219-b8d5-4fd786dcfec1-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:23 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" returned: 0 in 0.395s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:23 devstack sudo[111507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb 1G Aug 19 00:22:23 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-2edecc25-de01-4b1e-924c-b0f0d57346c8-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-2edecc25-de01-4b1e-924c-b0f0d57346c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-quobyte-2edecc25-de01-4b1e-924c-b0f0d57346c8" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-2edecc25-de01-4b1e-924c-b0f0d57346c8" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfb2a96-f602-48af-ad55-4139f54749fb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:23 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb 1G" returned: 0 in 0.467s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:23 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 Aug 19 00:22:23 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:23 devstack sudo[111521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb Aug 19 00:22:23 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:24 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8" returned: 0 in 0.436s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:24 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb" returned: 0 in 0.336s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:24 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb is being set with open permissions: ugo+rw Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:24 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8 Aug 19 00:22:24 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:24 devstack sudo[111531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb Aug 19 00:22:24 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:24 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2edecc25-de01-4b1e-924c-b0f0d57346c8" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-2edecc25-de01-4b1e-924c-b0f0d57346c8" released by "delete_volume" :: held 0.753s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:24 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb" returned: 0 in 0.267s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:24 devstack sudo[111536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info Aug 19 00:22:24 devstack sudo[111536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Created reservations ['2b45f2fc-4df0-4a7e-8760-b8f19bf8bb57', 'e35d20ef-196d-4f09-8422-be3b883ffe18', '49cd05e0-d082-4c59-9b60-e893cf7b3ea5', '62c262bc-04a8-4795-9b01-7c25c728c78a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:24 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:24 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:24 devstack sudo[111536]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:24 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info is being set with open permissions: ugo+rw Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:24 devstack sudo[111544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info Aug 19 00:22:24 devstack sudo[111544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-6f9697c5-76e3-4174-bdee-df4f27e9670f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-6f9697c5-76e3-4174-bdee-df4f27e9670f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "cinder-quobyte-6f9697c5-76e3-4174-bdee-df4f27e9670f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:24 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.284s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-6f9697c5-76e3-4174-bdee-df4f27e9670f" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Deleted volume successfully. Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d941af8e-0631-49e4-8edd-cf79c7c83471]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2ac409f-98ae-417b-8705-cd5a8757459b tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-2edecc25-de01-4b1e-924c-b0f0d57346c8-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:25 devstack sudo[111544]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.info" returned: 0 in 0.287s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:25 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f Aug 19 00:22:25 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e7f6e35d-b9be-4311-996b-b3712cca02d1 tempest-VolumeDependencyTests-1365618473 None] Create snapshot completed successfully Aug 19 00:22:25 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:25 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f Aug 19 00:22:25 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:25 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6f9697c5-76e3-4174-bdee-df4f27e9670f" returned: 0 in 0.251s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-quobyte-6f9697c5-76e3-4174-bdee-df4f27e9670f" released by "delete_volume" :: held 0.678s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Created reservations ['b0e9c30b-0e3b-4fe3-86d5-5ea060f0981f', '7429289d-c3ed-483e-ab47-e577dfd20260', 'de6b4812-c755-4413-bb8d-61f102b3c16b', '0ce6b5e9-2972-4262-88c5-af126c912dad'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:25 devstack sudo[111560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:25 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:25 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Deleted volume successfully. Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-43b96ee7-8f2b-4b93-ba9d-3e97acf4ad27 tempest-CinderUnicodeTest-1066944777 None] Lock "cinder-6f9697c5-76e3-4174-bdee-df4f27e9670f-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Flow 'volume_create_manager' (f08fd1af-92f8-48ac-8edf-d46a60924b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0a34fc-eaa4-4384-afa2-850799740f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0a34fc-eaa4-4384-afa2-850799740f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1323963835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6279d942-6a53-4e4e-86c0-376da3b5b3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612b62172b9e40e8a3119a350395a12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efe1b083-6e95-4216-aa81-6ca512bc5ddb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:27Z,use_quota=True,user_id='4e57dc13ce73428fbc9ced68e23ea3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8912ea-d4a5-4ef5-91e1-609ca8cd97e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8912ea-d4a5-4ef5-91e1-609ca8cd97e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18d9ffc-6315-46ff-98f6-98f9063d340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18d9ffc-6315-46ff-98f6-98f9063d340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6279d942-6a53-4e4e-86c0-376da3b5b3a9', 'volume_name': 'volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9', 'volume_size': 1, 'snapshot_id': 'efe1b083-6e95-4216-aa81-6ca512bc5ddb'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e90e69-2c86-4fd3-86ff-657ae604e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e90e69-2c86-4fd3-86ff-657ae604e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9504d0f-54f7-4ebd-be93-b6d81f7c28c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Volume 6279d942-6a53-4e4e-86c0-376da3b5b3a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9', 'volume_size': 1, 'snapshot_id': 'efe1b083-6e95-4216-aa81-6ca512bc5ddb'} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-quobyte-efe1b083-6e95-4216-aa81-6ca512bc5ddb-6279d942-6a53-4e4e-86c0-376da3b5b3a9" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-efe1b083-6e95-4216-aa81-6ca512bc5ddb-6279d942-6a53-4e4e-86c0-376da3b5b3a9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Creating volume 6279d942-6a53-4e4e-86c0-376da3b5b3a9 from snapshot efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-quobyte-6279d942-6a53-4e4e-86c0-376da3b5b3a9" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-6279d942-6a53-4e4e-86c0-376da3b5b3a9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] snapshot: efe1b083-6e95-4216-aa81-6ca512bc5ddb, volume: 6279d942-6a53-4e4e-86c0-376da3b5b3a9, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33599cd4-fc4f-4409-98f2-70b5328858a7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:27 devstack sudo[111563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb Aug 19 00:22:27 devstack sudo[111563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:27 devstack sudo[111563]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[186fbaa6-121f-46f4-8e0f-bb5ec24bf238]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:27 devstack sudo[111572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e Aug 19 00:22:27 devstack sudo[111572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:27 devstack sudo[111572]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" returned: 0 in 0.417s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:22:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:27 devstack sudo[111577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 Aug 19 00:22:27 devstack sudo[111577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-c318a65b-c2e5-452e-af6a-34ef17eeb571 req-19c05248-ab8b-4570-afb6-1c048ec84eba tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=196,cinder:SELECT=145,cinder:DELETE=19,cinder:INSERT=48 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=143,cinder:INSERT=44,cinder:UPDATE=169,cinder:DELETE=15 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Flow 'volume_create_manager' (27509d30-7daa-4abf-bb9e-ec126702e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa62501-402c-4eb8-b76f-e8bdb69bb950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa62501-402c-4eb8-b76f-e8bdb69bb950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-240771934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8bb328-0894-4a0e-81ba-0418c996d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa1e090cb9744d99cac69b839173420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:33Z,use_quota=True,user_id='5b23889427384c149fcadce6d1c433da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16329a95-fe48-40a5-a4ab-076f32304000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16329a95-fe48-40a5-a4ab-076f32304000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34d15f-9c5d-4afe-b775-bb86218b47d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34d15f-9c5d-4afe-b775-bb86218b47d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8bb328-0894-4a0e-81ba-0418c996d4a9', 'volume_name': 'volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3008a4b8-5436-497f-8aac-2389b5cadfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3008a4b8-5436-497f-8aac-2389b5cadfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8006f74f-5bf1-4bab-b757-5b4bd8ade153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:33 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Volume 0d8bb328-0894-4a0e-81ba-0418c996d4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9', 'volume_size': 1} Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-fc53e4ff-6909-4a29-85c2-c3834e90b211 tempest-TestShelveInstance-1486191736 None] Terminate volume connection completed successfully. Aug 19 00:22:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-fc53e4ff-6909-4a29-85c2-c3834e90b211 tempest-TestShelveInstance-1486191736 None] Deleting attachment af754405-e19c-45b7-aa7b-e7c228e4427a. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Acquiring lock "cinder-de9c5f49-feb4-4420-8223-9e6ad3778de6-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Lock "cinder-de9c5f49-feb4-4420-8223-9e6ad3778de6-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Acquiring lock "cinder-quobyte-de9c5f49-feb4-4420-8223-9e6ad3778de6" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Lock "cinder-quobyte-de9c5f49-feb4-4420-8223-9e6ad3778de6" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2787e75-d6a7-4212-8f1f-63588857ba47]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:34 devstack sudo[111636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 Aug 19 00:22:34 devstack sudo[111636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:34 devstack sudo[111577]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9" returned: 0 in 6.681s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:22:34 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Converted 1024.00 MB image at 153.24 MB/s Aug 19 00:22:34 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 is being set with open permissions: ugo+rw Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:34 devstack sudo[111638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 Aug 19 00:22:34 devstack sudo[111638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:34 devstack sudo[111636]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6" returned: 0 in 0.438s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:34 devstack sudo[111638]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9" returned: 0 in 0.283s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:34 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6 Aug 19 00:22:34 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-6279d942-6a53-4e4e-86c0-376da3b5b3a9" released by "_copy_volume_from_snapshot" :: held 7.917s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-efe1b083-6e95-4216-aa81-6ca512bc5ddb-6279d942-6a53-4e4e-86c0-376da3b5b3a9" released by "_create_volume_from_snapshot" :: held 7.982s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.999s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-c318a65b-c2e5-452e-af6a-34ef17eeb571 req-19c05248-ab8b-4570-afb6-1c048ec84eba tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.272s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-c318a65b-c2e5-452e-af6a-34ef17eeb571 req-19c05248-ab8b-4570-afb6-1c048ec84eba tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-240771934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8bb328-0894-4a0e-81ba-0418c996d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa1e090cb9744d99cac69b839173420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:33Z,use_quota=True,user_id='5b23889427384c149fcadce6d1c433da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Creating volume 0d8bb328-0894-4a0e-81ba-0418c996d4a9 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:34 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9504d0f-54f7-4ebd-be93-b6d81f7c28c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9', 'volume_size': 1, 'snapshot_id': 'efe1b083-6e95-4216-aa81-6ca512bc5ddb'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:34 devstack sudo[111646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 1073741824 Aug 19 00:22:34 devstack sudo[111646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32689edf-02cb-429c-ba2d-fc183e29ecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Volume volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 (6279d942-6a53-4e4e-86c0-376da3b5b3a9): created successfully Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32689edf-02cb-429c-ba2d-fc183e29ecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Flow 'volume_create_manager' (f08fd1af-92f8-48ac-8edf-d46a60924b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-c318a65b-c2e5-452e-af6a-34ef17eeb571 req-19c05248-ab8b-4570-afb6-1c048ec84eba tempest-TestInstancesWithCinderVolumes-1662922289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcab5ddb-148f-4399-a831-35846115f9cb', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:22:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8184f8bd-dd8a-4559-ad3c-5268acab40b9 tempest-VolumeDependencyTests-1365618473 None] Created volume successfully. Aug 19 00:22:35 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-de9c5f49-feb4-4420-8223-9e6ad3778de6" returned: 0 in 0.296s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Lock "cinder-quobyte-de9c5f49-feb4-4420-8223-9e6ad3778de6" released by "delete_volume" :: held 0.833s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-c318a65b-c2e5-452e-af6a-34ef17eeb571 req-19c05248-ab8b-4570-afb6-1c048ec84eba tempest-TestInstancesWithCinderVolumes-1662922289 None] attachment_update completed successfully. Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.quota [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Created reservations ['a9d804fc-4b04-437c-a45c-b795d4bb7b6f', 'ae4cee11-f02e-4d72-b883-a012feb1068f', 'a5330ab8-d594-41e3-8b6d-617adb9cbcdb', '801295eb-d60c-46df-b64e-d7bae3feebb2'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:35 devstack sudo[111654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:35 devstack sudo[111654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-efe1b083-6e95-4216-aa81-6ca512bc5ddb-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-efe1b083-6e95-4216-aa81-6ca512bc5ddb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-quobyte-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-quobyte-efe1b083-6e95-4216-aa81-6ca512bc5ddb" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-efe1b083-6e95-4216-aa81-6ca512bc5ddb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Deleting offline snapshot efe1b083-6e95-4216-aa81-6ca512bc5ddb of volume c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] snapshot_file for this snap is: volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca7a7b-c782-4c73-9f67-d3d410c0b348]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:35 devstack sudo[111646]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 1073741824" returned: 0 in 0.741s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:35 devstack sudo[111654]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.manager [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Deleted volume successfully. Aug 19 00:22:35 devstack sudo[111662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 Aug 19 00:22:35 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:35 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb Aug 19 00:22:35 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [req-0adac750-600c-462d-b940-dc4d0540e5e2 req-739a9c4f-0d93-4b58-95be-16656cda143f tempest-TestShelveInstance-1486191736 None] Lock "cinder-de9c5f49-feb4-4420-8223-9e6ad3778de6-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:36 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9" returned: 0 in 0.358s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8006f74f-5bf1-4bab-b757-5b4bd8ade153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6010e927-5df2-458f-be1f-7ff895f7b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Volume volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 (0d8bb328-0894-4a0e-81ba-0418c996d4a9): created successfully Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6010e927-5df2-458f-be1f-7ff895f7b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:36 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Flow 'volume_create_manager' (27509d30-7daa-4abf-bb9e-ec126702e749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb" returned: 0 in 0.500s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:22:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f499a5e2-609b-430a-96d8-2031671c57a4 tempest-ProjectReaderTests-154900676 None] Created volume successfully. Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b471c-9e85-44f8-9179-d5ff3f2b7194]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:36 devstack sudo[111669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e Aug 19 00:22:36 devstack sudo[111669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:36 devstack sudo[111669]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" returned: 0 in 0.640s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:36 devstack sudo[111679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb Aug 19 00:22:36 devstack sudo[111679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Acquiring lock "cinder-0d8bb328-0894-4a0e-81ba-0418c996d4a9-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Lock "cinder-0d8bb328-0894-4a0e-81ba-0418c996d4a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Acquiring lock "cinder-quobyte-0d8bb328-0894-4a0e-81ba-0418c996d4a9" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Lock "cinder-quobyte-0d8bb328-0894-4a0e-81ba-0418c996d4a9" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225cd49-b0a0-42fd-82a4-b6c3ed5455e4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:37 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 Aug 19 00:22:37 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:37 devstack sudo[111679]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb" returned: 0 in 0.498s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:37 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb Aug 19 00:22:37 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:37 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9" returned: 0 in 0.540s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:37 devstack sudo[111697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9 Aug 19 00:22:37 devstack sudo[111697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:37 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e.efe1b083-6e95-4216-aa81-6ca512bc5ddb" returned: 0 in 0.357s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-efe1b083-6e95-4216-aa81-6ca512bc5ddb" released by "_delete_snapshot" :: held 2.163s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" released by "delete_snapshot" :: held 2.209s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Created reservations ['e3e2ffaf-b3ae-412a-b0b0-27a707698231', '8f6cef99-b2af-47cc-9b62-d96f32168a2a', '64ae6dc6-1005-4be9-ae35-8bf0f8d56bea', 'e9f036fe-7a4c-4d68-a7c8-6682b93343b7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Delete snapshot completed successfully. Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-da5f1d53-ebf4-49fc-8459-22959a5fbea8 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-efe1b083-6e95-4216-aa81-6ca512bc5ddb-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:37 devstack sudo[111697]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0d8bb328-0894-4a0e-81ba-0418c996d4a9" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Lock "cinder-quobyte-0d8bb328-0894-4a0e-81ba-0418c996d4a9" released by "delete_volume" :: held 0.979s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Created reservations ['282c0bca-a831-44db-b997-6c4fa086e632', '76939a82-9393-42d2-a192-d0cd695a88ce', 'dcf00640-4f6a-4c8b-bf5f-34977eed6e7b', '695daf54-19bc-475a-8f99-bf1c07eac9ab'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-84188b5e-8610-4483-b5fb-284418a4db6b req-29e49aff-2be7-476a-907a-d298ae41bcb5 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-84188b5e-8610-4483-b5fb-284418a4db6b req-29e49aff-2be7-476a-907a-d298ae41bcb5 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-84188b5e-8610-4483-b5fb-284418a4db6b req-29e49aff-2be7-476a-907a-d298ae41bcb5 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-84188b5e-8610-4483-b5fb-284418a4db6b req-29e49aff-2be7-476a-907a-d298ae41bcb5 tempest-TestInstancesWithCinderVolumes-1662922289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0bf009a-95db-44be-af04-54102f8cb587', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:22:38 devstack sudo[111709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:38 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-84188b5e-8610-4483-b5fb-284418a4db6b req-29e49aff-2be7-476a-907a-d298ae41bcb5 tempest-TestInstancesWithCinderVolumes-1662922289 None] attachment_update completed successfully. Aug 19 00:22:38 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.296s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Deleted volume successfully. Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0d2ab18a-86fc-4cfb-aa86-d2721840f936 tempest-ProjectReaderTests-154900676 None] Lock "cinder-0d8bb328-0894-4a0e-81ba-0418c996d4a9-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-c92f92a4-7fc3-4b26-a098-c4d5da642e8e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-c92f92a4-7fc3-4b26-a098-c4d5da642e8e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-quobyte-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[102ca6a8-63c1-40a6-b23f-a3031b72f238]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:39 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e Aug 19 00:22:39 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:39 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:39 devstack sudo[111722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e Aug 19 00:22:39 devstack sudo[111722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:39 devstack sudo[111722]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-c92f92a4-7fc3-4b26-a098-c4d5da642e8e" released by "delete_volume" :: held 0.795s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Flow 'volume_create_manager' (75c4c582-4ac9-4b21-8e93-674e68633ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87dc015-7485-4558-a3dd-2c25d99cc4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Created reservations ['1878bd32-cf30-463b-ad00-2be3bbe07f52', 'e5117953-6257-4160-9cbd-fd43e8865f0e', 'fa678e31-cb41-4e30-8b9b-21285796e04c', '894d90e4-2f82-4632-ada0-d2d921da16e1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87dc015-7485-4558-a3dd-2c25d99cc4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699977823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6db49e1-2170-47ef-a6d6-cf47b91abacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa1e090cb9744d99cac69b839173420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:40Z,use_quota=True,user_id='5b23889427384c149fcadce6d1c433da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3cb3be-b863-4ece-9148-62b517772670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3cb3be-b863-4ece-9148-62b517772670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d725f170-46b5-46e5-8a22-ec871ded366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d725f170-46b5-46e5-8a22-ec871ded366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6db49e1-2170-47ef-a6d6-cf47b91abacd', 'volume_name': 'volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e764ee-7a28-4703-a9cd-cce1a62834a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e764ee-7a28-4703-a9cd-cce1a62834a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba3bc15-1e4f-4873-9037-2b02614306c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Volume f6db49e1-2170-47ef-a6d6-cf47b91abacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd', 'volume_size': 1} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699977823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6db49e1-2170-47ef-a6d6-cf47b91abacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa1e090cb9744d99cac69b839173420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:40Z,use_quota=True,user_id='5b23889427384c149fcadce6d1c433da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Creating volume f6db49e1-2170-47ef-a6d6-cf47b91abacd {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:39 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:39 devstack sudo[111725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd 1073741824 Aug 19 00:22:39 devstack sudo[111725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:39 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:39 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-6279d942-6a53-4e4e-86c0-376da3b5b3a9-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-6279d942-6a53-4e4e-86c0-376da3b5b3a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "cinder-quobyte-6279d942-6a53-4e4e-86c0-376da3b5b3a9" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-6279d942-6a53-4e4e-86c0-376da3b5b3a9" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead467b-28fc-4a7e-b69d-1bb4b09e44e3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:40 devstack sudo[111734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 Aug 19 00:22:40 devstack sudo[111734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:40 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.405s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Deleted volume successfully. Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a10f25b6-bc2c-4623-bf50-0edde6a0eb25 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-c92f92a4-7fc3-4b26-a098-c4d5da642e8e-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:40 devstack sudo[111725]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd 1073741824" returned: 0 in 0.704s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:40 devstack sudo[111745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd Aug 19 00:22:40 devstack sudo[111745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:40 devstack sudo[111734]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9" returned: 0 in 0.545s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:40 devstack sudo[111748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9 Aug 19 00:22:40 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:40 devstack sudo[111745]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba3bc15-1e4f-4873-9037-2b02614306c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dc7f91-3eda-4762-87fc-260b7b11eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:40 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Volume volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd (f6db49e1-2170-47ef-a6d6-cf47b91abacd): created successfully Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dc7f91-3eda-4762-87fc-260b7b11eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Flow 'volume_create_manager' (75c4c582-4ac9-4b21-8e93-674e68633ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4559fa16-f922-4b80-99f1-796949660ac2 tempest-ProjectReaderTests-154900676 None] Created volume successfully. Aug 19 00:22:40 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6279d942-6a53-4e4e-86c0-376da3b5b3a9" returned: 0 in 0.331s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-quobyte-6279d942-6a53-4e4e-86c0-376da3b5b3a9" released by "delete_volume" :: held 0.929s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Created reservations ['4e37bec2-a962-454d-ae71-ee1df8a2ef8a', 'f7d5baa5-1425-4406-bd05-bbd36a61ad45', '27eac1e6-a9a1-424e-b6a2-18dad1026e2c', '65d20b4a-4d40-4e83-80b9-418a0d93cc1d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:41 devstack sudo[111752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:41 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:41 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.324s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Deleted volume successfully. Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-03bc1f9b-831b-4731-8369-96d0c6332dc4 tempest-VolumeDependencyTests-1365618473 None] Lock "cinder-6279d942-6a53-4e4e-86c0-376da3b5b3a9-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Acquiring lock "cinder-f6db49e1-2170-47ef-a6d6-cf47b91abacd-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Lock "cinder-f6db49e1-2170-47ef-a6d6-cf47b91abacd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Acquiring lock "cinder-quobyte-f6db49e1-2170-47ef-a6d6-cf47b91abacd" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Lock "cinder-quobyte-f6db49e1-2170-47ef-a6d6-cf47b91abacd" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee949200-b649-40e2-a0fb-3339603db285]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:42 devstack sudo[111757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd Aug 19 00:22:42 devstack sudo[111757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:42 devstack sudo[111757]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd" returned: 0 in 0.491s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:42 devstack sudo[111762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd Aug 19 00:22:42 devstack sudo[111762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:42 devstack sudo[111762]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-f6db49e1-2170-47ef-a6d6-cf47b91abacd" returned: 0 in 0.376s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Lock "cinder-quobyte-f6db49e1-2170-47ef-a6d6-cf47b91abacd" released by "delete_volume" :: held 0.929s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Created reservations ['5b8bebe6-0ce6-4838-9398-361c0d334b2e', 'c26b323f-0c81-4a9e-a223-53c30e9785b3', '58ac6d80-45ea-467d-b791-fa3417034c49', 'd4a52c3a-c65c-4b05-829d-7a0065c9552d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:43 devstack sudo[111773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:43 devstack sudo[111773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:43 devstack sudo[111773]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Deleted volume successfully. Aug 19 00:22:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-86447a78-ad65-4688-8022-911d52b22da0 tempest-ProjectReaderTests-154900676 None] Lock "cinder-f6db49e1-2170-47ef-a6d6-cf47b91abacd-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-b84f36f6-e1dc-48fc-9c9d-3f5751be5161 req-01dd3940-20ed-46f8-8828-a3f658f9cad1 tempest-TestInstancesWithCinderVolumes-1662922289 None] Terminate volume connection completed successfully. Aug 19 00:22:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-b84f36f6-e1dc-48fc-9c9d-3f5751be5161 req-01dd3940-20ed-46f8-8828-a3f658f9cad1 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deleting attachment bcab5ddb-148f-4399-a831-35846115f9cb. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:22:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "cinder-1416a99d-77d1-41a4-a70d-c5e4f12639a7-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-1416a99d-77d1-41a4-a70d-c5e4f12639a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "cinder-quobyte-1416a99d-77d1-41a4-a70d-c5e4f12639a7" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-quobyte-1416a99d-77d1-41a4-a70d-c5e4f12639a7" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[969e2824-8748-4ea1-b351-af04875d4c65]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:46 devstack sudo[111800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 Aug 19 00:22:46 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:46 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:46 devstack sudo[111805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7 Aug 19 00:22:46 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:46 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1416a99d-77d1-41a4-a70d-c5e4f12639a7" returned: 0 in 0.323s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-quobyte-1416a99d-77d1-41a4-a70d-c5e4f12639a7" released by "delete_volume" :: held 0.837s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:46 devstack cinder-volume[94243]: WARNING cinder.quota [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-662873843-594342678 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-662873843-594342678, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:22:46 devstack cinder-volume[94243]: WARNING cinder.quota [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-662873843-594342678 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-662873843-594342678, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:22:46 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Created reservations ['3be9820c-4c5b-4485-b362-1ec4e7c6dd75', '6c294afa-ac5c-4e29-960d-d203080ae6a9', 'c04b2c9f-7c41-4333-840e-62eca17901da', '1017e489-c86c-496a-9be4-ce3ab10755f8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:47 devstack sudo[111809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:47 devstack sudo[111809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:47 devstack sudo[111809]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deleted volume successfully. Aug 19 00:22:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-936d70be-950b-42c8-bffd-98245ded14d9 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-1416a99d-77d1-41a4-a70d-c5e4f12639a7-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:48 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (5dea18f3-d50a-47f4-a8e9-07196eec7fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346e9a46-54a7-4638-909e-6fac9a3353f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346e9a46-54a7-4638-909e-6fac9a3353f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585217184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18361309-bb73-4a6b-b31d-abba5f4c829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:49Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb690f02-8397-4849-970b-f9ce4f287bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb690f02-8397-4849-970b-f9ce4f287bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c349bad5-720a-4858-b8b1-e06bc98386d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c349bad5-720a-4858-b8b1-e06bc98386d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18361309-bb73-4a6b-b31d-abba5f4c829b', 'volume_name': 'volume-18361309-bb73-4a6b-b31d-abba5f4c829b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a3cd8a-28ed-4fe8-b6d3-b9eccfb02812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a3cd8a-28ed-4fe8-b6d3-b9eccfb02812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc02168-1d40-4b27-9126-6c8d7909ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Volume 18361309-bb73-4a6b-b31d-abba5f4c829b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18361309-bb73-4a6b-b31d-abba5f4c829b', 'volume_size': 1} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585217184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18361309-bb73-4a6b-b31d-abba5f4c829b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:49Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Creating volume 18361309-bb73-4a6b-b31d-abba5f4c829b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:49 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:49 devstack sudo[111830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b 1073741824 Aug 19 00:22:49 devstack sudo[111830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:49 devstack sudo[111830]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b 1073741824" returned: 0 in 0.602s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:49 devstack sudo[111840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b Aug 19 00:22:49 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:50 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc02168-1d40-4b27-9126-6c8d7909ef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18361309-bb73-4a6b-b31d-abba5f4c829b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e1cd11-721c-40fa-bb4f-066f63043b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Volume volume-18361309-bb73-4a6b-b31d-abba5f4c829b (18361309-bb73-4a6b-b31d-abba5f4c829b): created successfully Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e1cd11-721c-40fa-bb4f-066f63043b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (5dea18f3-d50a-47f4-a8e9-07196eec7fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-43cde500-3f9b-4347-a32e-1aa4bf86ffa2 tempest-ProjectReaderTests-430642730 None] Created volume successfully. Aug 19 00:22:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-82002493-8328-4e2c-bc1e-4aec8c7050ef req-24732cae-70af-4f55-a623-a23c3e12e576 tempest-TestInstancesWithCinderVolumes-1662922289 None] Terminate volume connection completed successfully. Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-82002493-8328-4e2c-bc1e-4aec8c7050ef req-24732cae-70af-4f55-a623-a23c3e12e576 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deleting attachment a0bf009a-95db-44be-af04-54102f8cb587. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "cinder-6cafa8d3-f1f8-49eb-b207-dfeb948879d4-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-6cafa8d3-f1f8-49eb-b207-dfeb948879d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "cinder-quobyte-6cafa8d3-f1f8-49eb-b207-dfeb948879d4" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-quobyte-6cafa8d3-f1f8-49eb-b207-dfeb948879d4" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[106a6735-65a2-4125-90b9-30d2438d1d90]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:51 devstack sudo[111848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 Aug 19 00:22:51 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:51 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:51 devstack sudo[111853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4 Aug 19 00:22:51 devstack sudo[111853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-18361309-bb73-4a6b-b31d-abba5f4c829b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Lock "cinder-18361309-bb73-4a6b-b31d-abba5f4c829b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-quobyte-18361309-bb73-4a6b-b31d-abba5f4c829b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-18361309-bb73-4a6b-b31d-abba5f4c829b" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a046f-5f42-4beb-890d-016f6c7f5976]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:51 devstack sudo[111855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b Aug 19 00:22:51 devstack sudo[111855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:51 devstack sudo[111853]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6cafa8d3-f1f8-49eb-b207-dfeb948879d4" returned: 0 in 0.433s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-quobyte-6cafa8d3-f1f8-49eb-b207-dfeb948879d4" released by "delete_volume" :: held 0.927s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:51 devstack cinder-volume[94243]: WARNING cinder.quota [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1649264165-987863390 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1649264165-987863390, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:22:51 devstack cinder-volume[94243]: WARNING cinder.quota [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1649264165-987863390 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1649264165-987863390, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Created reservations ['1093a26a-4d2f-47ed-9097-83736dcf1d7b', 'c39a83fa-40c6-4b07-be5a-c4aad4d2fd7e', 'd3c31294-2e6d-4bc8-9b8f-865f1d77a1d9', '291dc444-a7ef-4c26-87d4-41a0f06c10df'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:52 devstack sudo[111862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:52 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:52 devstack sudo[111855]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b" returned: 0 in 0.456s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:52 devstack sudo[111865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b Aug 19 00:22:52 devstack sudo[111865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:52 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.377s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deleted volume successfully. Aug 19 00:22:52 devstack sudo[111865]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e4d4e4ad-61c6-47d6-be9a-ac26880d10a8 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-6cafa8d3-f1f8-49eb-b207-dfeb948879d4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-18361309-bb73-4a6b-b31d-abba5f4c829b" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-18361309-bb73-4a6b-b31d-abba5f4c829b" released by "delete_volume" :: held 0.873s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Created reservations ['bbf1997a-5283-49ce-b3e0-2a26eb7f184d', '660daf56-6e51-41f2-8347-387c40743270', 'c273f93e-c018-4a1a-a9ac-64946fdcacfc', 'bdf84aee-c9c2-45aa-92d9-e4c5a6b38695'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:52 devstack sudo[111870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:52 devstack sudo[111870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:53 devstack sudo[111870]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Deleted volume successfully. Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1b39a453-dc63-4436-8f1b-d115fd33daa6 tempest-ProjectReaderTests-430642730 None] Lock "cinder-18361309-bb73-4a6b-b31d-abba5f4c829b-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (59a8e6ac-24fe-4639-a227-32b2b2eee833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9c133e-afce-47f3-8748-bfc7dbb5e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9c133e-afce-47f3-8748-bfc7dbb5e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240757943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0c6b10-abe7-4248-b085-7aad6b96e87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:53Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7d6385-8569-472c-b7c1-764a429d8d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7d6385-8569-472c-b7c1-764a429d8d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1d3f11-606d-47f1-a85b-0da988b43184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1d3f11-606d-47f1-a85b-0da988b43184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0c6b10-abe7-4248-b085-7aad6b96e87e', 'volume_name': 'volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e27461d-3450-4d1e-92d5-20b15b777566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e27461d-3450-4d1e-92d5-20b15b777566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6accc434-a450-4da8-a7ad-ed2df154ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:53 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Volume 1c0c6b10-abe7-4248-b085-7aad6b96e87e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e', 'volume_size': 1} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240757943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0c6b10-abe7-4248-b085-7aad6b96e87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:53Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Creating volume 1c0c6b10-abe7-4248-b085-7aad6b96e87e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:53 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:53 devstack sudo[111873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e 1073741824 Aug 19 00:22:53 devstack sudo[111873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:54 devstack sudo[111873]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e 1073741824" returned: 0 in 0.649s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:54 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e Aug 19 00:22:54 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:54 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6accc434-a450-4da8-a7ad-ed2df154ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4948c5-7422-47bb-84a5-1cc8a19b47b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:54 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Volume volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e (1c0c6b10-abe7-4248-b085-7aad6b96e87e): created successfully Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4948c5-7422-47bb-84a5-1cc8a19b47b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (59a8e6ac-24fe-4639-a227-32b2b2eee833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:54 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bea99686-26d6-448a-a63b-ce19eebe07b6 tempest-ProjectReaderTests-430642730 None] Created volume successfully. Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-1c0c6b10-abe7-4248-b085-7aad6b96e87e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-1c0c6b10-abe7-4248-b085-7aad6b96e87e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-quobyte-1c0c6b10-abe7-4248-b085-7aad6b96e87e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-1c0c6b10-abe7-4248-b085-7aad6b96e87e" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f4c880-1853-40db-a280-a16a70cd4367]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-1d734559-8364-4162-9028-97e2ed7e15f9 req-d49744e6-99ea-4b8f-a4fe-ca8b61b662f0 tempest-TestInstancesWithCinderVolumes-1662922289 None] Terminate volume connection completed successfully. Aug 19 00:22:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-1d734559-8364-4162-9028-97e2ed7e15f9 req-d49744e6-99ea-4b8f-a4fe-ca8b61b662f0 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deleting attachment 46f7ddd4-6338-47d1-8d8d-773ecc6cc01f. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:22:55 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e Aug 19 00:22:55 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:56 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e" returned: 0 in 0.420s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:56 devstack sudo[111915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e Aug 19 00:22:56 devstack sudo[111915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Flow 'volume_create_manager' (f7ea6a41-eed6-41bf-bce3-05426b09a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:56 devstack sudo[111915]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da113b3-8b8b-4728-96fb-93e8d69f5d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c0c6b10-abe7-4248-b085-7aad6b96e87e" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-1c0c6b10-abe7-4248-b085-7aad6b96e87e" released by "delete_volume" :: held 0.800s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da113b3-8b8b-4728-96fb-93e8d69f5d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0a7b99-1b3f-4dd9-bb45-4432aa769bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8db6d9d17f4378b20574a523b3041c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:56Z,use_quota=True,user_id='80672c5e56c3438fbeab4a9ff9b913a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e11895e7-b00a-48a9-a8dd-32999d3f0567),volume_type_id=e11895e7-b00a-48a9-a8dd-32999d3f0567)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282be5a2-5790-4fa4-aa92-25346378c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282be5a2-5790-4fa4-aa92-25346378c136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe2461f-3622-4e5d-9be8-58f1652cf006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Created reservations ['9d4df8e6-7142-4671-a37d-e3f0c38c4051', '3f73e922-4aa3-4994-a0b9-d6a4f64d3591', 'a29ab268-1200-40b0-855a-7d5604fa56d4', '2d6ba942-5cbb-442f-88d6-131fa2ada158'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:56 devstack sudo[111918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:56 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe2461f-3622-4e5d-9be8-58f1652cf006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d0a7b99-1b3f-4dd9-bb45-4432aa769bee', 'volume_name': 'volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee', 'volume_size': 1, 'image_id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb302006-1e76-49e1-9180-0ae42935706b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a7a5038e809390a8707a226547f6c9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e8db6d9d17f4378b20574a523b3041c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '223aacec9e1c0d357510ba506c8ed243d11bd699c899272f7c2154c38c502b2d375ae7ea8323f224b6d4931cbc4060198f3b73a2656a2145f0adaf975593ec83', 'id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'created_at': datetime.datetime(2026, 8, 18, 22, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 22, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb302006-1e76-49e1-9180-0ae42935706b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c1fb1a-4b61-4b12-8747-8cc8914e5a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c1fb1a-4b61-4b12-8747-8cc8914e5a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c4e4c0-37a5-4390-9613-b98aeae56f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:56 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Volume 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee', 'volume_size': 1, 'image_id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb302006-1e76-49e1-9180-0ae42935706b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a7a5038e809390a8707a226547f6c9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e8db6d9d17f4378b20574a523b3041c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '223aacec9e1c0d357510ba506c8ed243d11bd699c899272f7c2154c38c502b2d375ae7ea8323f224b6d4931cbc4060198f3b73a2656a2145f0adaf975593ec83', 'id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'created_at': datetime.datetime(2026, 8, 18, 22, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 22, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb302006-1e76-49e1-9180-0ae42935706b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Trying to clone 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee from image eb302006-1e76-49e1-9180-0ae42935706b at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb302006-1e76-49e1-9180-0ae42935706b', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "cinder-0ff7b18d-a4e2-46b8-b815-4913916846e9-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-0ff7b18d-a4e2-46b8-b815-4913916846e9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:56 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:22:56 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Image download 0.00 MB at 0.00 MB/s Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "cinder-quobyte-0ff7b18d-a4e2-46b8-b815-4913916846e9" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-quobyte-0ff7b18d-a4e2-46b8-b815-4913916846e9" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:57 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Deleted volume successfully. Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6277ebe5-0496-4457-beaf-e237541b7a8a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b221df-e9f5-4c92-b8a1-816b8ef5b38a]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-472f8afe-25ef-4a80-aac0-83f91c84ddd9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-1c0c6b10-abe7-4248-b085-7aad6b96e87e-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:57 devstack sudo[111922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 Aug 19 00:22:57 devstack sudo[111922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:57 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD Aug 19 00:22:57 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (9c5028a7-2d6d-4f2a-9879-52ba2e118377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823abca0-8b9b-4bd1-b299-3db82ccc6470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823abca0-8b9b-4bd1-b299-3db82ccc6470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083727579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19ae247-e6b2-4657-98bc-7134bd7f1da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:57Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7289385d-f644-4ce5-823a-0970956f12dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7289385d-f644-4ce5-823a-0970956f12dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:57 devstack sudo[111922]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26aa101-ab0a-4f0e-89a0-05e8f2a52acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26aa101-ab0a-4f0e-89a0-05e8f2a52acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19ae247-e6b2-4657-98bc-7134bd7f1da5', 'volume_name': 'volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de16af1-f9f4-4515-9344-053a10b2830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:57 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de16af1-f9f4-4515-9344-053a10b2830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13b76d-21e0-4895-abb4-4775ebcad3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:57 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Volume b19ae247-e6b2-4657-98bc-7134bd7f1da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5', 'volume_size': 1} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083727579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19ae247-e6b2-4657-98bc-7134bd7f1da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:57Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Creating volume b19ae247-e6b2-4657-98bc-7134bd7f1da5 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:57 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:57 devstack sudo[111931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 1073741824 Aug 19 00:22:57 devstack sudo[111931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:57 devstack sudo[111932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9 Aug 19 00:22:57 devstack sudo[111932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:57 devstack sudo[111934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD Aug 19 00:22:57 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:57 devstack sudo[111932]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-0ff7b18d-a4e2-46b8-b815-4913916846e9" returned: 0 in 0.247s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-quobyte-0ff7b18d-a4e2-46b8-b815-4913916846e9" released by "delete_volume" :: held 0.758s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:57 devstack cinder-volume[94243]: WARNING cinder.quota [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904086137-1259679553 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904086137-1259679553, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:22:57 devstack cinder-volume[94243]: WARNING cinder.quota [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904086137-1259679553 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-904086137-1259679553, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Created reservations ['e5ceb149-3f62-42ba-8c5d-527c927a2f59', '4377d5a4-886d-418e-9aec-ad7ad3d8ef7d', '0de8ad8c-40ae-4207-9cb9-8bec3570e294', 'aa79d5b9-5a96-4076-99dd-fedfb100f7fd'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:22:57 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Temporary image eb302006-1e76-49e1-9180-0ae42935706b is fetched for user 80672c5e56c3438fbeab4a9ff9b913a8. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:57 devstack sudo[111931]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 1073741824" returned: 0 in 0.451s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:57 devstack sudo[111945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:22:57 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd7ef51-35cf-47df-8522-43dea04f3f16]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:58 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 Aug 19 00:22:58 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:58 devstack sudo[111947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD Aug 19 00:22:58 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:58 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:22:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Deleted volume successfully. Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5dd232f-a18d-4c9d-aebc-0db5ca51a3b6 tempest-TestInstancesWithCinderVolumes-1662922289 None] Lock "cinder-0ff7b18d-a4e2-46b8-b815-4913916846e9-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:22:58 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5" returned: 0 in 0.314s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13b76d-21e0-4895-abb4-4775ebcad3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:58 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f97b7b9-5892-4892-a0d5-73a81aed9fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:58 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Volume volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 (b19ae247-e6b2-4657-98bc-7134bd7f1da5): created successfully Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f97b7b9-5892-4892-a0d5-73a81aed9fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (9c5028a7-2d6d-4f2a-9879-52ba2e118377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:22:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a008408a-762f-4bef-b092-1d23620b0491 tempest-ProjectReaderTests-430642730 None] Created volume successfully. Aug 19 00:22:58 devstack sudo[111955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD Aug 19 00:22:58 devstack sudo[111955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:58 devstack sudo[111955]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0a7b99-1b3f-4dd9-bb45-4432aa769bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8db6d9d17f4378b20574a523b3041c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:22:56Z,use_quota=True,user_id='80672c5e56c3438fbeab4a9ff9b913a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e11895e7-b00a-48a9-a8dd-32999d3f0567),volume_type_id=e11895e7-b00a-48a9-a8dd-32999d3f0567)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Creating volume 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:22:58 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:22:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:58 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee 1073741824 Aug 19 00:22:58 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:59 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee 1073741824" returned: 0 in 0.448s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:59 devstack sudo[111966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee Aug 19 00:22:59 devstack sudo[111966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:59 devstack sudo[111966]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Attempting download of eb302006-1e76-49e1-9180-0ae42935706b ((None, [{'url': 'file:///opt/stack/data/glance/images/eb302006-1e76-49e1-9180-0ae42935706b', 'metadata': {}}])) to volume 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-b19ae247-e6b2-4657-98bc-7134bd7f1da5-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a70ce-9208-4066-a2d5-4fdb1a900de4]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Lock "cinder-b19ae247-e6b2-4657-98bc-7134bd7f1da5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-quobyte-b19ae247-e6b2-4657-98bc-7134bd7f1da5" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-b19ae247-e6b2-4657-98bc-7134bd7f1da5" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f39830-8aef-4fa7-9359-b53bfbb61822]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:22:59 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg Aug 19 00:22:59 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:59 devstack sudo[111971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 Aug 19 00:22:59 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:22:59 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg" returned: 0 in 0.388s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:22:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:00 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg Aug 19 00:23:00 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:00 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:00 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5 Aug 19 00:23:00 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:00 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg" returned: 1 in 0.376s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb302006-1e76-49e1-9180-0ae42935706b_vpfaz4qg' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[54528b07-b800-4c10-9a66-60ff4bae330c]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:00 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-b19ae247-e6b2-4657-98bc-7134bd7f1da5" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-b19ae247-e6b2-4657-98bc-7134bd7f1da5" released by "delete_volume" :: held 0.758s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Created reservations ['f070367c-dd9c-453a-9828-7100cd2f506f', '27988964-1c58-4309-b765-3984612ace9a', 'd1ead75d-7b48-44e0-ba0b-73fc12a9e92e', '937527a6-3da1-47bd-8094-7da06b64bf01'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:00 devstack sudo[111986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD Aug 19 00:23:00 devstack sudo[111986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:00 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:00 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:00 devstack sudo[111986]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:00 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.289s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Deleted volume successfully. Aug 19 00:23:00 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD Aug 19 00:23:00 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cb5ef79a-b8eb-4cbb-b99f-ae8fa2faca52 tempest-ProjectReaderTests-430642730 None] Lock "cinder-b19ae247-e6b2-4657-98bc-7134bd7f1da5-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:01 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] eb302006-1e76-49e1-9180-0ae42935706b was raw, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:01 devstack sudo[111998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee Aug 19 00:23:01 devstack sudo[111998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (e02a0bb7-9b80-4c7f-af6f-1fee67b37c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4d21e1-7697-4bb7-9ee8-ed6eb237e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4d21e1-7697-4bb7-9ee8-ed6eb237e41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055019568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396afb12-43d8-48f1-ae63-06cae25792ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:01Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da0fb9-db34-4020-b601-8e7a275f0f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da0fb9-db34-4020-b601-8e7a275f0f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824134af-69a4-4d51-8d43-74f2f61fe9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824134af-69a4-4d51-8d43-74f2f61fe9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396afb12-43d8-48f1-ae63-06cae25792ca', 'volume_name': 'volume-396afb12-43d8-48f1-ae63-06cae25792ca', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6fb087-4b96-49be-ba63-bc869651b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6fb087-4b96-49be-ba63-bc869651b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73327cf3-8c2d-4c91-8a71-43606b6f311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:01 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Volume 396afb12-43d8-48f1-ae63-06cae25792ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396afb12-43d8-48f1-ae63-06cae25792ca', 'volume_size': 1} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2055019568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396afb12-43d8-48f1-ae63-06cae25792ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924f21409d154e30a4194c4d09c75ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:01Z,use_quota=True,user_id='afe404c434d84852a8dce8a1be146c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Creating volume 396afb12-43d8-48f1-ae63-06cae25792ca {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:01 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:01 devstack sudo[112002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca 1073741824 Aug 19 00:23:01 devstack sudo[112002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:01 devstack sudo[111998]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" returned: 0 in 0.501s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb302006-1e76-49e1-9180-0ae42935706b_gz1qdklbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:23:01 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Converted 0.00 MB image at 0.00 MB/s Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:01 devstack sudo[112010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee 1G Aug 19 00:23:01 devstack sudo[112010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:01 devstack sudo[112002]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca 1073741824" returned: 0 in 0.470s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:01 devstack sudo[112015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca Aug 19 00:23:01 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:01 devstack sudo[112010]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee 1G" returned: 0 in 0.334s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Downloaded image eb302006-1e76-49e1-9180-0ae42935706b ((None, [{'url': 'file:///opt/stack/data/glance/images/eb302006-1e76-49e1-9180-0ae42935706b', 'metadata': {}}])) to volume 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Temporary image eb302006-1e76-49e1-9180-0ae42935706b for user 80672c5e56c3438fbeab4a9ff9b913a8 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:23:01 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Marking volume 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Copying metadata from image eb302006-1e76-49e1-9180-0ae42935706b to 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Creating volume glance metadata for volume 3d0a7b99-1b3f-4dd9-bb45-4432aa769bee backed by image eb302006-1e76-49e1-9180-0ae42935706b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8a7a5038e809390a8707a226547f6c9b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c4e4c0-37a5-4390-9613-b98aeae56f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee', 'volume_size': 1, 'image_id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb302006-1e76-49e1-9180-0ae42935706b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a7a5038e809390a8707a226547f6c9b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2e8db6d9d17f4378b20574a523b3041c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '223aacec9e1c0d357510ba506c8ed243d11bd699c899272f7c2154c38c502b2d375ae7ea8323f224b6d4931cbc4060198f3b73a2656a2145f0adaf975593ec83', 'id': 'eb302006-1e76-49e1-9180-0ae42935706b', 'created_at': datetime.datetime(2026, 8, 18, 22, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 22, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb302006-1e76-49e1-9180-0ae42935706b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3831599-61c3-44ae-b305-801c3336e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Volume volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee (3d0a7b99-1b3f-4dd9-bb45-4432aa769bee): created successfully Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3831599-61c3-44ae-b305-801c3336e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Flow 'volume_create_manager' (f7ea6a41-eed6-41bf-bce3-05426b09a52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e8c573ba-5e27-476d-b7bd-b0e4d803c8d5 tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Created volume successfully. Aug 19 00:23:02 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca" returned: 0 in 0.275s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73327cf3-8c2d-4c91-8a71-43606b6f311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396afb12-43d8-48f1-ae63-06cae25792ca', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2637e9d-b5c2-4f16-bf4c-c3af5402dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:02 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Volume volume-396afb12-43d8-48f1-ae63-06cae25792ca (396afb12-43d8-48f1-ae63-06cae25792ca): created successfully Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2637e9d-b5c2-4f16-bf4c-c3af5402dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Flow 'volume_create_manager' (e02a0bb7-9b80-4c7f-af6f-1fee67b37c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3c00f61b-dd0d-4273-befc-da09968a5761 tempest-ProjectReaderTests-430642730 None] Created volume successfully. Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Acquiring lock "cinder-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "cinder-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Acquiring lock "cinder-quobyte-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "cinder-quobyte-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" acquired by "delete_volume" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36831c-3c11-44a0-b011-da1db7fbb56f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:03 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee Aug 19 00:23:03 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-396afb12-43d8-48f1-ae63-06cae25792ca-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:03 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-396afb12-43d8-48f1-ae63-06cae25792ca-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:03 devstack sudo[112026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee Aug 19 00:23:03 devstack sudo[112026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Acquiring lock "cinder-quobyte-396afb12-43d8-48f1-ae63-06cae25792ca" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-396afb12-43d8-48f1-ae63-06cae25792ca" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb03841-a25f-4914-a626-07585fa57c86]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:03 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca Aug 19 00:23:03 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:03 devstack sudo[112026]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" returned: 0 in 0.274s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "cinder-quobyte-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee" released by "delete_volume" :: held 0.765s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:03 devstack cinder-volume[94243]: WARNING cinder.quota [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:23:03 devstack cinder-volume[94243]: WARNING cinder.quota [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Created reservations ['51a59930-6614-41cf-a100-fd02b81373ff', '2b1f5a4f-b573-4c3a-9c48-2584aa52322b', '2b8b0457-90cc-4d2e-a5c5-1abf54c6a0a2', '7b132393-fee1-450a-8afe-1d0649349ed9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:03 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:03 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:03 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:03 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca Aug 19 00:23:03 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:04 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Deleted volume successfully. Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-475baa3c-326b-4802-82b4-c91f13f3741f tempest-VolumeAndVolumeTypeFromImageTest-89274409 None] Lock "cinder-3d0a7b99-1b3f-4dd9-bb45-4432aa769bee-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:04 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-396afb12-43d8-48f1-ae63-06cae25792ca" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-quobyte-396afb12-43d8-48f1-ae63-06cae25792ca" released by "delete_volume" :: held 0.762s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Created reservations ['0bf49f5e-bd12-4751-b95f-b791f6aff5a0', 'ede76b23-0b48-4b0b-b6e8-ca1dc75780cb', 'd6e1b3fb-e2ee-4512-b485-bbfedb12a3d3', '5bb8a94b-f66c-45ac-aa21-e8827af8d960'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:04 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:04 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:04 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.282s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Deleted volume successfully. Aug 19 00:23:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5426ea7e-b6ec-4a6e-9301-f9f2bb71dff9 tempest-ProjectReaderTests-430642730 None] Lock "cinder-396afb12-43d8-48f1-ae63-06cae25792ca-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (1c0f7349-a789-49e7-9569-47becc518f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c9a3b5-aea6-4ead-8ee1-661eb3209d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c9a3b5-aea6-4ead-8ee1-661eb3209d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825072118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b832f1-62cb-471b-bba4-67b69f67ab1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:10Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed21ea50-26e8-4bf5-b5a3-a275aca55bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed21ea50-26e8-4bf5-b5a3-a275aca55bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd01c95-c169-42a5-915f-dbbaebfd2e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd01c95-c169-42a5-915f-dbbaebfd2e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b832f1-62cb-471b-bba4-67b69f67ab1e', 'volume_name': 'volume-43b832f1-62cb-471b-bba4-67b69f67ab1e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a273f296-ea88-41ce-bbf8-6d7ac7c29f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a273f296-ea88-41ce-bbf8-6d7ac7c29f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec87aff-df87-4a6f-9157-ebd1eeae613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume 43b832f1-62cb-471b-bba4-67b69f67ab1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b832f1-62cb-471b-bba4-67b69f67ab1e', 'volume_size': 1} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825072118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b832f1-62cb-471b-bba4-67b69f67ab1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:10Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Creating volume 43b832f1-62cb-471b-bba4-67b69f67ab1e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:10 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:10 devstack sudo[112045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e 1073741824 Aug 19 00:23:10 devstack sudo[112045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:11 devstack sudo[112045]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e 1073741824" returned: 0 in 0.500s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:11 devstack sudo[112051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e Aug 19 00:23:11 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:11 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e" returned: 0 in 0.300s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec87aff-df87-4a6f-9157-ebd1eeae613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b832f1-62cb-471b-bba4-67b69f67ab1e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb7567-69aa-43a2-8720-e1b85f0f206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume volume-43b832f1-62cb-471b-bba4-67b69f67ab1e (43b832f1-62cb-471b-bba4-67b69f67ab1e): created successfully Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb7567-69aa-43a2-8720-e1b85f0f206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (1c0f7349-a789-49e7-9569-47becc518f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a6b4d58f-230c-4342-8a08-eb4530330e7e tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created volume successfully. Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:13 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:13 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (ebecd6bb-7b19-4c1f-b8f4-22c215389740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec31cb4-d295-45ff-aa44-9bc3956ad259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec31cb4-d295-45ff-aa44-9bc3956ad259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095855984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a520f7-8bc6-498a-8632-80385f11373f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:14Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfde6091-f519-4d8f-9113-cd2d70b75f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfde6091-f519-4d8f-9113-cd2d70b75f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:13 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8feec3a-7b64-4b4d-9f2c-d5d86166577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8feec3a-7b64-4b4d-9f2c-d5d86166577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a520f7-8bc6-498a-8632-80385f11373f', 'volume_name': 'volume-14a520f7-8bc6-498a-8632-80385f11373f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a2215-b448-439e-ada0-c22ddf3093ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642a2215-b448-439e-ada0-c22ddf3093ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c465d88-3fa2-401f-92de-a3220155a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:13 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume 14a520f7-8bc6-498a-8632-80385f11373f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a520f7-8bc6-498a-8632-80385f11373f', 'volume_size': 1} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095855984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a520f7-8bc6-498a-8632-80385f11373f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:14Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Creating volume 14a520f7-8bc6-498a-8632-80385f11373f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:13 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.526s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:13 devstack sudo[112058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f 1073741824 Aug 19 00:23:13 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (e867de8b-4702-46e4-93c0-55790949dd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283a88a2-749c-4ff6-a3ca-7422ef87cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283a88a2-749c-4ff6-a3ca-7422ef87cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774861459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b77c6f1-618a-434d-8e93-4429b81df3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:14Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b24b5a2-e1cb-4fdd-b4bb-507ad38359db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b24b5a2-e1cb-4fdd-b4bb-507ad38359db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d02cf6-aef7-49a2-b48a-82b4622407b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d02cf6-aef7-49a2-b48a-82b4622407b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b77c6f1-618a-434d-8e93-4429b81df3b4', 'volume_name': 'volume-9b77c6f1-618a-434d-8e93-4429b81df3b4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19e85d2-b101-4d34-82f5-68d47f217647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19e85d2-b101-4d34-82f5-68d47f217647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959a9b10-62db-4356-abd6-29827ebcdeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume 9b77c6f1-618a-434d-8e93-4429b81df3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b77c6f1-618a-434d-8e93-4429b81df3b4', 'volume_size': 1} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (7f352ae5-26c9-4bfd-b5f6-3c6b9a7131ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70fbf4b-a275-48b6-9041-ea822b2f1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70fbf4b-a275-48b6-9041-ea822b2f1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-115071816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dbc0c7-aa00-493a-a3f1-4406bd78ed6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:14Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d979ee-0ad5-44fe-a214-b0ef6822321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d979ee-0ad5-44fe-a214-b0ef6822321b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb30caf-93e9-427f-b999-f849124b92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb30caf-93e9-427f-b999-f849124b92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35dbc0c7-aa00-493a-a3f1-4406bd78ed6a', 'volume_name': 'volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df751c7-bbc0-4f4f-901c-09f81b03c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df751c7-bbc0-4f4f-901c-09f81b03c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff8668d-e599-4f7d-a5dd-535320934cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume 35dbc0c7-aa00-493a-a3f1-4406bd78ed6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a', 'volume_size': 1} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:14 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f 1073741824" returned: 0 in 0.777s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:14 devstack sudo[112065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f Aug 19 00:23:14 devstack sudo[112065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (090bfe65-01bf-4a0e-a329-d82df43dfd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a14662f-f764-47fa-b9a7-a957112f6478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a14662f-f764-47fa-b9a7-a957112f6478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812662609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b3c1b6-e67b-45b7-8580-9395f4008ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:15Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc733eed-c929-4c5c-9d04-8702264d9082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc733eed-c929-4c5c-9d04-8702264d9082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14823d54-be4e-4f92-8610-faacbf7bc4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14823d54-be4e-4f92-8610-faacbf7bc4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b3c1b6-e67b-45b7-8580-9395f4008ade', 'volume_name': 'volume-84b3c1b6-e67b-45b7-8580-9395f4008ade', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d3b02c-46b3-49ef-8b99-f5231c119b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d3b02c-46b3-49ef-8b99-f5231c119b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82692be-1027-4e3b-94f3-582466f1fc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume 84b3c1b6-e67b-45b7-8580-9395f4008ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b3c1b6-e67b-45b7-8580-9395f4008ade', 'volume_size': 1} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:15 devstack sudo[112065]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f" returned: 0 in 0.395s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774861459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b77c6f1-618a-434d-8e93-4429b81df3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:14Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Creating volume 9b77c6f1-618a-434d-8e93-4429b81df3b4 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:15 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c465d88-3fa2-401f-92de-a3220155a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a520f7-8bc6-498a-8632-80385f11373f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693f6f58-507d-40f3-be9f-01fe8f65ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack sudo[112068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 1073741824 Aug 19 00:23:15 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume volume-14a520f7-8bc6-498a-8632-80385f11373f (14a520f7-8bc6-498a-8632-80385f11373f): created successfully Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693f6f58-507d-40f3-be9f-01fe8f65ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (ebecd6bb-7b19-4c1f-b8f4-22c215389740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-641d0248-2250-45b1-a15e-a2dc8b60ea86 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created volume successfully. Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (a7186c6a-4c43-41f5-856f-66d05cd78c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d1883b-1bf8-4131-8ff9-29f9142d51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d1883b-1bf8-4131-8ff9-29f9142d51af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973425364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabd0cbf-1de5-4daa-b41d-75edca0d372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:15Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffc052a-718f-44e3-90ae-3ec69ea8e4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffc052a-718f-44e3-90ae-3ec69ea8e4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775024af-897b-48a3-a933-2c1ed0e6e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775024af-897b-48a3-a933-2c1ed0e6e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabd0cbf-1de5-4daa-b41d-75edca0d372b', 'volume_name': 'volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6425ca5-38ff-4e8e-ba56-6dae515b64a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6425ca5-38ff-4e8e-ba56-6dae515b64a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b473d1fa-efed-4c88-9c01-7e293fad96ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume dabd0cbf-1de5-4daa-b41d-75edca0d372b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b', 'volume_size': 1} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:15 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 1073741824" returned: 0 in 0.649s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:15 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 Aug 19 00:23:15 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:16 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4" returned: 0 in 0.319s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-115071816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dbc0c7-aa00-493a-a3f1-4406bd78ed6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:14Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Creating volume 35dbc0c7-aa00-493a-a3f1-4406bd78ed6a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:16 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959a9b10-62db-4356-abd6-29827ebcdeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b77c6f1-618a-434d-8e93-4429b81df3b4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187ad688-4428-46d2-a58a-94fbc0071f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:16 devstack sudo[112112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a 1073741824 Aug 19 00:23:16 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:16 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 (9b77c6f1-618a-434d-8e93-4429b81df3b4): created successfully Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187ad688-4428-46d2-a58a-94fbc0071f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (e867de8b-4702-46e4-93c0-55790949dd18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-06d12480-42e2-428e-a498-4d14eae5a106 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created volume successfully. Aug 19 00:23:16 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a 1073741824" returned: 0 in 0.650s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:16 devstack sudo[112117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a Aug 19 00:23:16 devstack sudo[112117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:17 devstack sudo[112117]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812662609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b3c1b6-e67b-45b7-8580-9395f4008ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:15Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Creating volume 84b3c1b6-e67b-45b7-8580-9395f4008ade {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:17 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff8668d-e599-4f7d-a5dd-535320934cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44dcd80-74b6-4472-8569-7c72cda2eca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:17 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade 1073741824 Aug 19 00:23:17 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a (35dbc0c7-aa00-493a-a3f1-4406bd78ed6a): created successfully Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44dcd80-74b6-4472-8569-7c72cda2eca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (7f352ae5-26c9-4bfd-b5f6-3c6b9a7131ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-87b8408b-2ac7-472c-93b9-d5dd26592261 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created volume successfully. Aug 19 00:23:17 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade 1073741824" returned: 0 in 0.527s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:17 devstack sudo[112126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade Aug 19 00:23:17 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:18 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade" returned: 0 in 0.414s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.589s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1973425364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabd0cbf-1de5-4daa-b41d-75edca0d372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb9bb112d61421d894dbc9c7af028e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:15Z,use_quota=True,user_id='1ab32ba92c6f4f21b1e1837d516e114f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Creating volume dabd0cbf-1de5-4daa-b41d-75edca0d372b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:18 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82692be-1027-4e3b-94f3-582466f1fc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b3c1b6-e67b-45b7-8580-9395f4008ade', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:18 devstack sudo[112129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b 1073741824 Aug 19 00:23:18 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e726b-531b-452e-a51e-8f73d0cd237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:18 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume volume-84b3c1b6-e67b-45b7-8580-9395f4008ade (84b3c1b6-e67b-45b7-8580-9395f4008ade): created successfully Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e726b-531b-452e-a51e-8f73d0cd237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (090bfe65-01bf-4a0e-a329-d82df43dfd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:18 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-15a58f64-4a45-43ff-aa9a-b9dbfc678400 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created volume successfully. Aug 19 00:23:18 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b 1073741824" returned: 0 in 0.600s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:18 devstack sudo[112135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b Aug 19 00:23:18 devstack sudo[112135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:19 devstack sudo[112135]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b473d1fa-efed-4c88-9c01-7e293fad96ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c2dc91-ce9c-413b-87d4-a98e2781b01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Volume volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b (dabd0cbf-1de5-4daa-b41d-75edca0d372b): created successfully Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c2dc91-ce9c-413b-87d4-a98e2781b01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Flow 'volume_create_manager' (a7186c6a-4c43-41f5-856f-66d05cd78c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-911759c9-54ca-44c8-b85a-a541dc7e294a tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created volume successfully. Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-dabd0cbf-1de5-4daa-b41d-75edca0d372b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-dabd0cbf-1de5-4daa-b41d-75edca0d372b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-quobyte-dabd0cbf-1de5-4daa-b41d-75edca0d372b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-dabd0cbf-1de5-4daa-b41d-75edca0d372b" acquired by "delete_volume" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b0c10-cd2c-4a16-9a65-9496c5a221d9]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:20 devstack sudo[112139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b Aug 19 00:23:20 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:20 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:20 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b Aug 19 00:23:20 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:20 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dabd0cbf-1de5-4daa-b41d-75edca0d372b" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-dabd0cbf-1de5-4daa-b41d-75edca0d372b" released by "delete_volume" :: held 0.851s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:20 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created reservations ['8bc914cb-a9ce-4d2b-bf3c-50c8fce447aa', 'de1cd14a-fc55-46b0-b79a-d3cee60a8649', '44416c6b-0231-46ad-9043-8533d4ca058c', '8db6be58-5ab8-4c8c-9d45-c75f71690b17'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:21 devstack sudo[112147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:21 devstack sudo[112147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-84b3c1b6-e67b-45b7-8580-9395f4008ade-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-84b3c1b6-e67b-45b7-8580-9395f4008ade-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-quobyte-84b3c1b6-e67b-45b7-8580-9395f4008ade" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-84b3c1b6-e67b-45b7-8580-9395f4008ade" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ace4cc-d623-4759-8fc1-3eb019b19720]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:21 devstack sudo[112147]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.352s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Deleted volume successfully. Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8ca6087e-06fe-411a-a04e-aa1483784db2 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-dabd0cbf-1de5-4daa-b41d-75edca0d372b-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:21 devstack sudo[112150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade Aug 19 00:23:21 devstack sudo[112150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:21 devstack sudo[112150]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:21 devstack sudo[112157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade Aug 19 00:23:21 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:22 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-84b3c1b6-e67b-45b7-8580-9395f4008ade" returned: 0 in 0.346s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-84b3c1b6-e67b-45b7-8580-9395f4008ade" released by "delete_volume" :: held 0.883s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created reservations ['a5cc5d7e-3975-41fc-aab3-581d9338f618', 'd9229869-afb8-497d-b920-9783e70477fd', '94e5bf2a-83d7-48a5-994d-6ede13a7a519', '6d57612a-f5a8-4c32-b4f1-e5fac267c032'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:22 devstack sudo[112160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:22 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-quobyte-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6002c3d-6d7a-4e5f-b616-9dcfd3d7d95f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:22 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.366s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Deleted volume successfully. Aug 19 00:23:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-39613c68-a723-40dd-9e6f-32ade6969afa tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-84b3c1b6-e67b-45b7-8580-9395f4008ade-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:22 devstack sudo[112162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a Aug 19 00:23:22 devstack sudo[112162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:23 devstack sudo[112162]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a" returned: 0 in 0.475s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:23 devstack sudo[112169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a Aug 19 00:23:23 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:23 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a" released by "delete_volume" :: held 0.801s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created reservations ['bd8b03b0-4060-45cb-83e0-98f281341a8a', 'fb0ff656-d55a-4837-bdd1-a5b967cd21c6', '83e5c17e-7c27-4df4-beac-2819a7d25718', 'accdc385-d3f7-4f6b-9ba9-20210ced5178'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:23 devstack sudo[112172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:23 devstack sudo[112172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-9b77c6f1-618a-434d-8e93-4429b81df3b4-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-9b77c6f1-618a-434d-8e93-4429b81df3b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-quobyte-9b77c6f1-618a-434d-8e93-4429b81df3b4" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-9b77c6f1-618a-434d-8e93-4429b81df3b4" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:23 devstack sudo[112172]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.346s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Deleted volume successfully. Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f14148d-54e6-43db-8335-3d17d8e15a64]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3525b8b7-499d-4e93-a992-66bce7681219 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-35dbc0c7-aa00-493a-a3f1-4406bd78ed6a-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:24 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 Aug 19 00:23:24 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:24 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4" returned: 0 in 0.498s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:24 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4 Aug 19 00:23:24 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:24 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b77c6f1-618a-434d-8e93-4429b81df3b4" returned: 0 in 0.272s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-9b77c6f1-618a-434d-8e93-4429b81df3b4" released by "delete_volume" :: held 0.822s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created reservations ['4328edd1-e950-4e4a-922a-5a678b2935c9', 'f93b15b7-4bb1-4c5d-9982-29de32d56c24', '631e43a9-ca3e-4f9e-94d3-527114897933', '19a264d6-006d-4b33-8384-07488dec385f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:24 devstack sudo[112184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:24 devstack sudo[112184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-14a520f7-8bc6-498a-8632-80385f11373f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-14a520f7-8bc6-498a-8632-80385f11373f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-quobyte-14a520f7-8bc6-498a-8632-80385f11373f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-14a520f7-8bc6-498a-8632-80385f11373f" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf88a84-9535-46a3-9c11-f4b44e3976b5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:25 devstack sudo[112184]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Deleted volume successfully. Aug 19 00:23:25 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f Aug 19 00:23:25 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c1885fdc-6690-4d28-8eed-52c156f14cdb tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-9b77c6f1-618a-434d-8e93-4429b81df3b4-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:25 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f" returned: 0 in 0.481s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:25 devstack sudo[112199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f Aug 19 00:23:25 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:25 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-14a520f7-8bc6-498a-8632-80385f11373f" returned: 0 in 0.276s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-14a520f7-8bc6-498a-8632-80385f11373f" released by "delete_volume" :: held 0.828s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created reservations ['a6cf6079-4a4a-4665-9f7c-c5c662fa27bd', '5829a606-78e6-4c2d-8b9e-cf09bf3e0e6f', '22279d6c-adf7-41d5-bce6-971f424dbbc6', '8cc4f878-82a5-4851-b12f-b5067bcbf8c9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:26 devstack sudo[112202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:26 devstack sudo[112202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-43b832f1-62cb-471b-bba4-67b69f67ab1e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-43b832f1-62cb-471b-bba4-67b69f67ab1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "cinder-quobyte-43b832f1-62cb-471b-bba4-67b69f67ab1e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-43b832f1-62cb-471b-bba4-67b69f67ab1e" acquired by "delete_volume" :: waited 0.071s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:26 devstack sudo[112202]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.345s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Deleted volume successfully. Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee8361-31cf-4279-8b4f-c27b81d9752a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e2347e9c-b42d-41b0-8c38-3930bfe97914 tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-14a520f7-8bc6-498a-8632-80385f11373f-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:26 devstack sudo[112205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e Aug 19 00:23:26 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:26 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e" returned: 0 in 0.454s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:26 devstack sudo[112210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e Aug 19 00:23:26 devstack sudo[112210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:27 devstack sudo[112210]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-43b832f1-62cb-471b-bba4-67b69f67ab1e" returned: 0 in 0.356s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-quobyte-43b832f1-62cb-471b-bba4-67b69f67ab1e" released by "delete_volume" :: held 0.883s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Created reservations ['d0cee44d-59ae-4e0a-a941-85a32257fb6b', 'f7b173d3-8437-44fe-96eb-6fbf8d3e45d7', 'e8f40788-fa37-45ea-977e-28c6cf15c125', 'a1905b6f-6b2f-468d-bff2-a213da606a28'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:27 devstack sudo[112213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:27 devstack sudo[112213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:28 devstack sudo[112213]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.526s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:28 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Deleted volume successfully. Aug 19 00:23:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2d6f9d7c-cef9-4b10-831d-4c8ccda6f4ab tempest-CreateVolumesFromSourceVolumeTest-1812958410 None] Lock "cinder-43b832f1-62cb-471b-bba4-67b69f67ab1e-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=161,cinder:UPDATE=195,cinder:DELETE=15,cinder:INSERT=58 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=140,cinder:UPDATE=213,cinder:INSERT=46,cinder:DELETE=18 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Flow 'volume_create_manager' (4cf71c3c-836c-4cd5-9d49-c40ddbc03c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2c7718-31e2-444e-9149-b27e6f96fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2c7718-31e2-444e-9149-b27e6f96fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1927566894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a585bce4-0227-457a-9003-54b95307f4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40ee0301d224cbd9c947560d0cd5017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:34Z,use_quota=True,user_id='5db03a80eaa24becabc70d61ceedc752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221a25f7-8725-4dea-a913-f2f53723c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221a25f7-8725-4dea-a913-f2f53723c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbf594c-7ead-4e72-bf9e-655d93aa2595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbf594c-7ead-4e72-bf9e-655d93aa2595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a585bce4-0227-457a-9003-54b95307f4d4', 'volume_name': 'volume-a585bce4-0227-457a-9003-54b95307f4d4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e631fe2-9254-419e-9fb0-c2abd08bd41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e631fe2-9254-419e-9fb0-c2abd08bd41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0af44a-7f7f-4c3b-8bad-a9ed95193a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:33 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Volume a585bce4-0227-457a-9003-54b95307f4d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a585bce4-0227-457a-9003-54b95307f4d4', 'volume_size': 1} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1927566894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a585bce4-0227-457a-9003-54b95307f4d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40ee0301d224cbd9c947560d0cd5017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:34Z,use_quota=True,user_id='5db03a80eaa24becabc70d61ceedc752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Creating volume a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:33 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:33 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 1073741824 Aug 19 00:23:33 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:34 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 1073741824" returned: 0 in 0.528s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:34 devstack sudo[112225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 Aug 19 00:23:34 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:34 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0af44a-7f7f-4c3b-8bad-a9ed95193a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a585bce4-0227-457a-9003-54b95307f4d4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bca10b-1dfb-41d8-98b6-4edd122b5967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Volume volume-a585bce4-0227-457a-9003-54b95307f4d4 (a585bce4-0227-457a-9003-54b95307f4d4): created successfully Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bca10b-1dfb-41d8-98b6-4edd122b5967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Flow 'volume_create_manager' (4cf71c3c-836c-4cd5-9d49-c40ddbc03c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0cd67003-7f64-420e-b6f3-1d88801b561b tempest-SnapshotDependencyTests-1973753267 None] Created volume successfully. Aug 19 00:23:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Creating offline snapshot 4e15b97f-1f2c-4529-bbba-75ef4b642d03 of volume a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[26545469-85c2-42db-a436-7f83efd53967]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:36 devstack sudo[112228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 Aug 19 00:23:36 devstack sudo[112228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:36 devstack sudo[112228]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:36 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 1G Aug 19 00:23:36 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Flow 'volume_create_manager' (96623422-8a9a-444f-ab5e-584dcf17ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e792248-a43a-49d3-a8cc-b630eba40947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e792248-a43a-49d3-a8cc-b630eba40947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed187d49-7780-47a8-9025-fb5edbad8c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d14228076340e5be5e54c832e2655c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:37Z,use_quota=True,user_id='afcb922ec8dd4ab1839a1a70304e25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074e0336-931d-4aa2-9f44-25d809c54940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074e0336-931d-4aa2-9f44-25d809c54940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9fb246-55b3-487f-990f-8d514c396ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9fb246-55b3-487f-990f-8d514c396ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed187d49-7780-47a8-9025-fb5edbad8c02', 'volume_name': 'volume-ed187d49-7780-47a8-9025-fb5edbad8c02', 'volume_size': 1, 'image_id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/375575d9-f3f7-4132-bedd-25dc15d6b58d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5bfbd729b2ba4b54725c70f158eae60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82d14228076340e5be5e54c832e2655c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6ac7786451de0a84209d29930ffd83f34ce8c622b3b3fb8a2f88b2dc7797b70e0f4fd9ccc515b62316be0edbe9adbea41ab95d3505fce09e768da75cb7d161e', 'id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'created_at': datetime.datetime(2026, 8, 18, 22, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/375575d9-f3f7-4132-bedd-25dc15d6b58d/file', 'properties': {}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c5160b-75eb-4862-8553-8a1d0966540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c5160b-75eb-4862-8553-8a1d0966540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb27fb0-a27e-4934-a70b-20543058ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:37 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Volume ed187d49-7780-47a8-9025-fb5edbad8c02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed187d49-7780-47a8-9025-fb5edbad8c02', 'volume_size': 1, 'image_id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/375575d9-f3f7-4132-bedd-25dc15d6b58d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5bfbd729b2ba4b54725c70f158eae60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82d14228076340e5be5e54c832e2655c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6ac7786451de0a84209d29930ffd83f34ce8c622b3b3fb8a2f88b2dc7797b70e0f4fd9ccc515b62316be0edbe9adbea41ab95d3505fce09e768da75cb7d161e', 'id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'created_at': datetime.datetime(2026, 8, 18, 22, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/375575d9-f3f7-4132-bedd-25dc15d6b58d/file', 'properties': {}}, 'image_service': } Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Trying to clone ed187d49-7780-47a8-9025-fb5edbad8c02 from image 375575d9-f3f7-4132-bedd-25dc15d6b58d at location (None, [{'url': 'file:///opt/stack/data/glance/images/375575d9-f3f7-4132-bedd-25dc15d6b58d', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:23:37 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 1G" returned: 0 in 0.600s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a585bce4-0227-457a-9003-54b95307f4d4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:37 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a585bce4-0227-457a-9003-54b95307f4d4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 Aug 19 00:23:37 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:23:37 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Image download 0.00 MB at 0.00 MB/s Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1b7870-6d21-441f-8b1b-a8f0b2589b1a]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:37 devstack sudo[112242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD Aug 19 00:23:37 devstack sudo[112242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:37 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a585bce4-0227-457a-9003-54b95307f4d4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03" returned: 0 in 0.371s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:37 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 is being set with open permissions: ugo+rw Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:37 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 Aug 19 00:23:37 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:37 devstack sudo[112242]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:37 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03" returned: 0 in 0.282s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:37 devstack sudo[112251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD Aug 19 00:23:37 devstack sudo[112251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:37 devstack sudo[112254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info Aug 19 00:23:37 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:38 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:38 devstack sudo[112251]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info" returned: 0 in 0.298s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:38 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info is being set with open permissions: ugo+rw Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Temporary image 375575d9-f3f7-4132-bedd-25dc15d6b58d is fetched for user afcb922ec8dd4ab1839a1a70304e25fc. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:23:38 devstack sudo[112260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info Aug 19 00:23:38 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f8199-ccc4-4d64-8bb1-e2159aaca238]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:38 devstack sudo[112262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD Aug 19 00:23:38 devstack sudo[112262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:38 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.info" returned: 0 in 0.302s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c2a72d59-ff25-4e83-aa05-29591fe0d4de tempest-SnapshotDependencyTests-1973753267 None] Create snapshot completed successfully Aug 19 00:23:38 devstack sudo[112262]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:38 devstack sudo[112267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD Aug 19 00:23:38 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:38 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed187d49-7780-47a8-9025-fb5edbad8c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d14228076340e5be5e54c832e2655c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:37Z,use_quota=True,user_id='afcb922ec8dd4ab1839a1a70304e25fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Creating volume ed187d49-7780-47a8-9025-fb5edbad8c02 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:39 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:39 devstack sudo[112272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 1073741824 Aug 19 00:23:39 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:39 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 1073741824" returned: 0 in 0.548s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:39 devstack sudo[112278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 Aug 19 00:23:39 devstack sudo[112278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Flow 'volume_create_manager' (f0b3800c-4b5c-4bf2-8fdb-7b79177a1267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:39 devstack sudo[112278]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce514b1-f293-4a8c-8c96-725d2d311a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02" returned: 0 in 0.332s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce514b1-f293-4a8c-8c96-725d2d311a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a577105-c12d-48a9-92d1-a3ac3337d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40ee0301d224cbd9c947560d0cd5017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e15b97f-1f2c-4529-bbba-75ef4b642d03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:40Z,use_quota=True,user_id='5db03a80eaa24becabc70d61ceedc752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78417e9-cd02-4458-a5fa-4be691c1bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78417e9-cd02-4458-a5fa-4be691c1bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b09bb8-f2b5-4f82-b35a-cbd998e768d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b09bb8-f2b5-4f82-b35a-cbd998e768d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a577105-c12d-48a9-92d1-a3ac3337d4e1', 'volume_name': 'volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1', 'volume_size': 1, 'snapshot_id': '4e15b97f-1f2c-4529-bbba-75ef4b642d03'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dd2896-3407-46b9-8496-369b5910cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17dd2896-3407-46b9-8496-369b5910cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c138ca-9693-43b9-80d3-a68c1ea1dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Volume 8a577105-c12d-48a9-92d1-a3ac3337d4e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1', 'volume_size': 1, 'snapshot_id': '4e15b97f-1f2c-4529-bbba-75ef4b642d03'} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-quobyte-4e15b97f-1f2c-4529-bbba-75ef4b642d03-8a577105-c12d-48a9-92d1-a3ac3337d4e1" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:39 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Attempting download of 375575d9-f3f7-4132-bedd-25dc15d6b58d ((None, [{'url': 'file:///opt/stack/data/glance/images/375575d9-f3f7-4132-bedd-25dc15d6b58d', 'metadata': {}}])) to volume ed187d49-7780-47a8-9025-fb5edbad8c02. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-4e15b97f-1f2c-4529-bbba-75ef4b642d03-8a577105-c12d-48a9-92d1-a3ac3337d4e1" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Creating volume 8a577105-c12d-48a9-92d1-a3ac3337d4e1 from snapshot 4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-quobyte-8a577105-c12d-48a9-92d1-a3ac3337d4e1" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-8a577105-c12d-48a9-92d1-a3ac3337d4e1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] snapshot: 4e15b97f-1f2c-4529-bbba-75ef4b642d03, volume: 8a577105-c12d-48a9-92d1-a3ac3337d4e1, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd60046-48b2-4b18-a187-480ab63a7f0e]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1c6a2e-dabd-4d86-8b79-0b9586cd0186]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:40 devstack sudo[112281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04 Aug 19 00:23:40 devstack sudo[112281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:40 devstack sudo[112282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 Aug 19 00:23:40 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:40 devstack sudo[112281]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04" returned: 0 in 0.374s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:40 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03" returned: 0 in 0.413s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a585bce4-0227-457a-9003-54b95307f4d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e4e28-48a3-468c-8b0b-417ba79e02a9]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:40 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04 Aug 19 00:23:40 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:40 devstack sudo[112291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 Aug 19 00:23:40 devstack sudo[112291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:40 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04" returned: 1 in 0.384s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_375575d9-f3f7-4132-bedd-25dc15d6b58d_7yvdvn04' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3993e-812c-4dfd-a8fc-5b39d1f4b7eb]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:40 devstack sudo[112291]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4" returned: 0 in 0.414s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:23:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:40 devstack sudo[112298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD Aug 19 00:23:40 devstack sudo[112298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:40 devstack sudo[112300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 Aug 19 00:23:40 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:41 devstack sudo[112298]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:41 devstack sudo[112308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD Aug 19 00:23:41 devstack sudo[112308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:41 devstack sudo[112308]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:23:41 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] 375575d9-f3f7-4132-bedd-25dc15d6b58d was raw, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:23:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:42 devstack sudo[112321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 Aug 19 00:23:42 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:43 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02" returned: 0 in 1.440s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:43 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_375575d9-f3f7-4132-bedd-25dc15d6b58d_l95by5yidevstack@QuobyteHD, size 0.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:23:43 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Converted 0.00 MB image at 0.00 MB/s Aug 19 00:23:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:43 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 1G Aug 19 00:23:43 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:44 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 1G" returned: 0 in 0.711s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Downloaded image 375575d9-f3f7-4132-bedd-25dc15d6b58d ((None, [{'url': 'file:///opt/stack/data/glance/images/375575d9-f3f7-4132-bedd-25dc15d6b58d', 'metadata': {}}])) to volume ed187d49-7780-47a8-9025-fb5edbad8c02 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Temporary image 375575d9-f3f7-4132-bedd-25dc15d6b58d for user afcb922ec8dd4ab1839a1a70304e25fc is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Marking volume ed187d49-7780-47a8-9025-fb5edbad8c02 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Copying metadata from image 375575d9-f3f7-4132-bedd-25dc15d6b58d to ed187d49-7780-47a8-9025-fb5edbad8c02. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Creating volume glance metadata for volume ed187d49-7780-47a8-9025-fb5edbad8c02 backed by image 375575d9-f3f7-4132-bedd-25dc15d6b58d with: {'image_id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a5bfbd729b2ba4b54725c70f158eae60', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb27fb0-a27e-4934-a70b-20543058ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed187d49-7780-47a8-9025-fb5edbad8c02', 'volume_size': 1, 'image_id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/375575d9-f3f7-4132-bedd-25dc15d6b58d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a5bfbd729b2ba4b54725c70f158eae60', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82d14228076340e5be5e54c832e2655c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6ac7786451de0a84209d29930ffd83f34ce8c622b3b3fb8a2f88b2dc7797b70e0f4fd9ccc515b62316be0edbe9adbea41ab95d3505fce09e768da75cb7d161e', 'id': '375575d9-f3f7-4132-bedd-25dc15d6b58d', 'created_at': datetime.datetime(2026, 8, 18, 22, 23, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/375575d9-f3f7-4132-bedd-25dc15d6b58d/file', 'properties': {}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb01d66-bec2-4e04-8f98-f243511b946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Volume volume-ed187d49-7780-47a8-9025-fb5edbad8c02 (ed187d49-7780-47a8-9025-fb5edbad8c02): created successfully Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb01d66-bec2-4e04-8f98-f243511b946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Flow 'volume_create_manager' (96623422-8a9a-444f-ab5e-584dcf17ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5207b8a2-0712-4001-9084-ea0a9706bad3 tempest-VolumeImageDependencyTests-1984507089 None] Created volume successfully. Aug 19 00:23:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Acquiring lock "cinder-ed187d49-7780-47a8-9025-fb5edbad8c02-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Lock "cinder-ed187d49-7780-47a8-9025-fb5edbad8c02-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Acquiring lock "cinder-quobyte-ed187d49-7780-47a8-9025-fb5edbad8c02" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Lock "cinder-quobyte-ed187d49-7780-47a8-9025-fb5edbad8c02" acquired by "delete_volume" :: waited 0.065s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[699b4861-dd55-473e-862c-07d9a6b58ff1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:46 devstack sudo[112332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 Aug 19 00:23:46 devstack sudo[112332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:46 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1" returned: 0 in 5.596s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:23:46 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Converted 1024.00 MB image at 182.94 MB/s Aug 19 00:23:46 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 is being set with open permissions: ugo+rw Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:46 devstack sudo[112334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 Aug 19 00:23:46 devstack sudo[112334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:46 devstack sudo[112332]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02" returned: 0 in 0.556s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:46 devstack sudo[112339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02 Aug 19 00:23:46 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:46 devstack sudo[112334]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-8a577105-c12d-48a9-92d1-a3ac3337d4e1" released by "_copy_volume_from_snapshot" :: held 6.801s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-4e15b97f-1f2c-4529-bbba-75ef4b642d03-8a577105-c12d-48a9-92d1-a3ac3337d4e1" released by "_create_volume_from_snapshot" :: held 6.868s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.889s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c138ca-9693-43b9-80d3-a68c1ea1dac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1', 'volume_size': 1, 'snapshot_id': '4e15b97f-1f2c-4529-bbba-75ef4b642d03'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c31f6f-15d3-40fe-9c59-cbdb5d6cd396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Volume volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 (8a577105-c12d-48a9-92d1-a3ac3337d4e1): created successfully Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c31f6f-15d3-40fe-9c59-cbdb5d6cd396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Flow 'volume_create_manager' (f0b3800c-4b5c-4bf2-8fdb-7b79177a1267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b5218221-ca74-4d86-b3f2-7029545d4fea tempest-SnapshotDependencyTests-1973753267 None] Created volume successfully. Aug 19 00:23:47 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ed187d49-7780-47a8-9025-fb5edbad8c02" returned: 0 in 0.279s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Lock "cinder-quobyte-ed187d49-7780-47a8-9025-fb5edbad8c02" released by "delete_volume" :: held 0.931s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Created reservations ['ad131ff9-0bc0-4ffc-af89-e3a189106755', '306c12e9-5f53-4a2c-a73a-63d6f1d51027', 'e9a9265c-c89f-42ad-8a5b-c758f2d912e0', '07cdd9f4-09b5-4ed6-9226-1704e609df99'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:47 devstack sudo[112343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:47 devstack sudo[112343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:47 devstack sudo[112343]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.247s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Deleted volume successfully. Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-57dbcaaf-78db-4b0b-856c-da4289729fcb tempest-VolumeImageDependencyTests-1984507089 None] Lock "cinder-ed187d49-7780-47a8-9025-fb5edbad8c02-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-4e15b97f-1f2c-4529-bbba-75ef4b642d03-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-4e15b97f-1f2c-4529-bbba-75ef4b642d03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-quobyte-a585bce4-0227-457a-9003-54b95307f4d4" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-a585bce4-0227-457a-9003-54b95307f4d4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:47 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-quobyte-4e15b97f-1f2c-4529-bbba-75ef4b642d03" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-4e15b97f-1f2c-4529-bbba-75ef4b642d03" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Deleting offline snapshot 4e15b97f-1f2c-4529-bbba-75ef4b642d03 of volume a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] snapshot_file for this snap is: volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94ec207-b7c6-4bf5-845d-5a8b42778dcd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Flow 'volume_create_manager' (8a12e526-a49f-4b6c-a287-edc5fe3f8185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb048bd3-95be-45a5-84d9-54d9ff4c7746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb048bd3-95be-45a5-84d9-54d9ff4c7746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-33103617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e3930d-f88e-4530-aceb-193bfdd4c86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824fdb934a434951a9de4280eb5d97ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:48Z,use_quota=True,user_id='96b3267e04444ef399615b05b54aeb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4ac6a0-0b4b-4acc-bd43-6e2193038913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4ac6a0-0b4b-4acc-bd43-6e2193038913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecd11a7-0709-47e8-9373-738d1ec020d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ecd11a7-0709-47e8-9373-738d1ec020d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e3930d-f88e-4530-aceb-193bfdd4c86c', 'volume_name': 'volume-34e3930d-f88e-4530-aceb-193bfdd4c86c', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b40311-16f8-4f87-b7a2-9b50811f1fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:48 devstack sudo[112346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 Aug 19 00:23:48 devstack sudo[112346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b40311-16f8-4f87-b7a2-9b50811f1fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d07c4db-788b-4d53-ad57-29994f056817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Volume 34e3930d-f88e-4530-aceb-193bfdd4c86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e3930d-f88e-4530-aceb-193bfdd4c86c', 'volume_size': 1} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-33103617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e3930d-f88e-4530-aceb-193bfdd4c86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824fdb934a434951a9de4280eb5d97ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:23:48Z,use_quota=True,user_id='96b3267e04444ef399615b05b54aeb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Creating volume 34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:23:48 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:48 devstack sudo[112348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c 1073741824 Aug 19 00:23:48 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:48 devstack sudo[112346]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03" returned: 0 in 0.452s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a585bce4-0227-457a-9003-54b95307f4d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9f0d11-9594-4275-93ea-aa1c57cbfe51]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:48 devstack sudo[112357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 Aug 19 00:23:48 devstack sudo[112357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:48 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c 1073741824" returned: 0 in 0.573s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:48 devstack sudo[112361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c Aug 19 00:23:48 devstack sudo[112361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:49 devstack sudo[112361]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c" returned: 0 in 0.325s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d07c4db-788b-4d53-ad57-29994f056817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e3930d-f88e-4530-aceb-193bfdd4c86c', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1ab159-dd51-453d-878e-97c913516f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:23:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Volume volume-34e3930d-f88e-4530-aceb-193bfdd4c86c (34e3930d-f88e-4530-aceb-193bfdd4c86c): created successfully Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1ab159-dd51-453d-878e-97c913516f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Flow 'volume_create_manager' (8a12e526-a49f-4b6c-a287-edc5fe3f8185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:23:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-28f38f4f-2865-49c1-9788-e7cd3068535a tempest-TestStampPattern-1543783778 None] Created volume successfully. Aug 19 00:23:49 devstack sudo[112357]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4" returned: 0 in 0.741s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:49 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 Aug 19 00:23:49 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:49 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03" returned: 0 in 0.519s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:49 devstack sudo[112376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03 Aug 19 00:23:49 devstack sudo[112376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:50 devstack sudo[112376]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4.4e15b97f-1f2c-4529-bbba-75ef4b642d03" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-4e15b97f-1f2c-4529-bbba-75ef4b642d03" released by "_delete_snapshot" :: held 2.252s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-a585bce4-0227-457a-9003-54b95307f4d4" released by "delete_snapshot" :: held 2.281s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:50 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Created reservations ['6e651108-b77d-4f6d-9a3f-ada52cc5413d', 'fc721fc7-1345-4086-b45a-4934b5b18275', '89fe180f-2c0d-4e75-aee9-05acff4d2044', 'b00fa737-e175-4638-bb62-4776e2e64158'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Delete snapshot completed successfully. Aug 19 00:23:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d64df8f-c7de-4381-bc92-d1b85e2919b6 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-4e15b97f-1f2c-4529-bbba-75ef4b642d03-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-a585bce4-0227-457a-9003-54b95307f4d4-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-a585bce4-0227-457a-9003-54b95307f4d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-quobyte-a585bce4-0227-457a-9003-54b95307f4d4" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-a585bce4-0227-457a-9003-54b95307f4d4" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa881818-11e4-46fc-8c70-e06b2d5d6ee2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:51 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 Aug 19 00:23:51 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:51 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4" returned: 0 in 0.474s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:51 devstack sudo[112401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4 Aug 19 00:23:51 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:52 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a585bce4-0227-457a-9003-54b95307f4d4" returned: 0 in 0.333s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-a585bce4-0227-457a-9003-54b95307f4d4" released by "delete_volume" :: held 0.911s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Created reservations ['46102a96-04ae-4cb4-8b1c-c74a53534326', '34e1e13e-0d76-4cdb-a650-572b004260f2', 'eed8d585-d880-4d5c-8d16-e7a3683c5d99', '75d9c161-e3d3-44a2-ad1b-ff137e67a534'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:52 devstack sudo[112404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:52 devstack sudo[112404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-8a577105-c12d-48a9-92d1-a3ac3337d4e1-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-8a577105-c12d-48a9-92d1-a3ac3337d4e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "cinder-quobyte-8a577105-c12d-48a9-92d1-a3ac3337d4e1" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-8a577105-c12d-48a9-92d1-a3ac3337d4e1" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8994ecc7-0904-4d10-9599-1f7b70a9013b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:52 devstack sudo[112404]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.380s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Deleted volume successfully. Aug 19 00:23:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9ebd98c0-c248-4ea5-a0c6-9e08fbb8decf tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-a585bce4-0227-457a-9003-54b95307f4d4-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:52 devstack sudo[112406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 Aug 19 00:23:52 devstack sudo[112406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:53 devstack sudo[112406]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1" returned: 0 in 0.420s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:53 devstack sudo[112412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1 Aug 19 00:23:53 devstack sudo[112412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:53 devstack sudo[112412]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-8a577105-c12d-48a9-92d1-a3ac3337d4e1" returned: 0 in 0.311s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-quobyte-8a577105-c12d-48a9-92d1-a3ac3337d4e1" released by "delete_volume" :: held 0.789s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Created reservations ['65da1630-6bfe-417b-b247-9226f2835e4f', '96e229b6-eddf-4997-82f2-7390e6e48a38', 'abd115df-970d-4052-b729-63d489eae508', '9774a6d6-8416-4f12-8fed-f95e4d065901'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:23:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:23:53 devstack sudo[112415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:23:53 devstack sudo[112415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:23:54 devstack sudo[112415]: pam_unix(sudo:session): session closed for user root Aug 19 00:23:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:23:54 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:23:54 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Deleted volume successfully. Aug 19 00:23:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-541ce0fb-d058-4650-8cd3-c82bf08a93e4 tempest-SnapshotDependencyTests-1973753267 None] Lock "cinder-8a577105-c12d-48a9-92d1-a3ac3337d4e1-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:24:03 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=33,cinder:UPDATE=44,cinder:INSERT=20,cinder:DELETE=3 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:24:04 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=44,cinder:UPDATE=44,cinder:DELETE=5,cinder:INSERT=10 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:13 devstack sudo[112528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:24:13 devstack sudo[112528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:13 devstack sudo[112528]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.251s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:24:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:24:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-bca793f3-c2a9-4415-884e-aedaa4759460 req-e3a11c67-4545-4855-8286-887210f21783 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:24:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-bca793f3-c2a9-4415-884e-aedaa4759460 req-e3a11c67-4545-4855-8286-887210f21783 tempest-TestStampPattern-1543783778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:24:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-bca793f3-c2a9-4415-884e-aedaa4759460 req-e3a11c67-4545-4855-8286-887210f21783 tempest-TestStampPattern-1543783778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:24:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-bca793f3-c2a9-4415-884e-aedaa4759460 req-e3a11c67-4545-4855-8286-887210f21783 tempest-TestStampPattern-1543783778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-34e3930d-f88e-4530-aceb-193bfdd4c86c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adb03e3c-0205-4f59-a971-fe9167804947', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:24:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-bca793f3-c2a9-4415-884e-aedaa4759460 req-e3a11c67-4545-4855-8286-887210f21783 tempest-TestStampPattern-1543783778 None] attachment_update completed successfully. Aug 19 00:24:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-3f46c47e-b6c3-4801-bd0d-428e19c1c551 req-99da114d-f9ef-4437-b75e-25882a251a2c tempest-TestStampPattern-1543783778 None] Terminate volume connection completed successfully. Aug 19 00:24:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-3f46c47e-b6c3-4801-bd0d-428e19c1c551 req-99da114d-f9ef-4437-b75e-25882a251a2c tempest-TestStampPattern-1543783778 None] Deleting attachment adb03e3c-0205-4f59-a971-fe9167804947. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Creating offline snapshot 209971ac-cead-4176-b43b-ed02dbca603e of volume 34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29e89d0-3591-4308-9fa5-c5731d116512]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:28 devstack sudo[113027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c Aug 19 00:24:28 devstack sudo[113027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:28 devstack sudo[113027]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c" returned: 0 in 0.359s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:28 devstack sudo[113034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e 1G Aug 19 00:24:28 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:28 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e 1G" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e3930d-f88e-4530-aceb-193bfdd4c86c -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:28 devstack sudo[113039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e3930d-f88e-4530-aceb-193bfdd4c86c -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e Aug 19 00:24:28 devstack sudo[113039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:29 devstack sudo[113039]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e3930d-f88e-4530-aceb-193bfdd4c86c -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e" returned: 0 in 0.298s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:29 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e is being set with open permissions: ugo+rw Aug 19 00:24:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:29 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e Aug 19 00:24:29 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:29 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e" returned: 0 in 0.241s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:29 devstack sudo[113047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info Aug 19 00:24:29 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:29 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info" returned: 0 in 0.260s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:29 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info is being set with open permissions: ugo+rw Aug 19 00:24:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:29 devstack sudo[113050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info Aug 19 00:24:29 devstack sudo[113050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:30 devstack sudo[113050]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.info" returned: 0 in 0.240s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:24:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-423a8ccf-8df3-4cf4-9056-9dbec3721a52 tempest-TestStampPattern-1543783778 None] Create snapshot completed successfully Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Flow 'volume_create_manager' (5b4e4e44-5c28-4b0c-807f-fb92df8b8d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7eaa6ab-3d03-4b37-b3e4-4c1fe3d622c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7eaa6ab-3d03-4b37-b3e4-4c1fe3d622c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-954076680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9480cc55-4b5c-4270-a6fd-01cb7c877f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824fdb934a434951a9de4280eb5d97ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=209971ac-cead-4176-b43b-ed02dbca603e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:24:37Z,use_quota=True,user_id='96b3267e04444ef399615b05b54aeb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005f22da-7e37-495e-88be-c7150a89d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005f22da-7e37-495e-88be-c7150a89d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eb5c59-97ef-445d-9c68-81b3ea417d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97eb5c59-97ef-445d-9c68-81b3ea417d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9480cc55-4b5c-4270-a6fd-01cb7c877f65', 'volume_name': 'volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65', 'volume_size': 1, 'snapshot_id': '209971ac-cead-4176-b43b-ed02dbca603e'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce01b6a-a098-46c7-8305-fa62f28ab923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce01b6a-a098-46c7-8305-fa62f28ab923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772a07cb-fa70-48ad-84c1-2204a16a0e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:24:36 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Volume 9480cc55-4b5c-4270-a6fd-01cb7c877f65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65', 'volume_size': 1, 'snapshot_id': '209971ac-cead-4176-b43b-ed02dbca603e'} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-quobyte-209971ac-cead-4176-b43b-ed02dbca603e-9480cc55-4b5c-4270-a6fd-01cb7c877f65" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-209971ac-cead-4176-b43b-ed02dbca603e-9480cc55-4b5c-4270-a6fd-01cb7c877f65" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Creating volume 9480cc55-4b5c-4270-a6fd-01cb7c877f65 from snapshot 209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-quobyte-9480cc55-4b5c-4270-a6fd-01cb7c877f65" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-9480cc55-4b5c-4270-a6fd-01cb7c877f65" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:24:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] snapshot: 209971ac-cead-4176-b43b-ed02dbca603e, volume: 9480cc55-4b5c-4270-a6fd-01cb7c877f65, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdeec12-5177-4eca-990b-98512bac0d1e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:37 devstack sudo[113086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e Aug 19 00:24:37 devstack sudo[113086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:37 devstack sudo[113086]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e" returned: 0 in 0.381s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e3930d-f88e-4530-aceb-193bfdd4c86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3760e7-ea6e-4bd5-aed4-2a40c6b800ac]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:37 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c Aug 19 00:24:37 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:37 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c" returned: 0 in 0.390s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:24:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:37 devstack sudo[113099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 Aug 19 00:24:37 devstack sudo[113099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:43 devstack sudo[113099]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65" returned: 0 in 5.815s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:24:43 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Converted 1024.00 MB image at 176.06 MB/s Aug 19 00:24:43 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 is being set with open permissions: ugo+rw Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:24:43 devstack sudo[113115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 Aug 19 00:24:43 devstack sudo[113115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:24:43 devstack sudo[113115]: pam_unix(sudo:session): session closed for user root Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65" returned: 0 in 0.288s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-9480cc55-4b5c-4270-a6fd-01cb7c877f65" released by "_copy_volume_from_snapshot" :: held 6.972s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-209971ac-cead-4176-b43b-ed02dbca603e-9480cc55-4b5c-4270-a6fd-01cb7c877f65" released by "_create_volume_from_snapshot" :: held 7.043s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:24:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.059s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:24:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772a07cb-fa70-48ad-84c1-2204a16a0e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65', 'volume_size': 1, 'snapshot_id': '209971ac-cead-4176-b43b-ed02dbca603e'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:24:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de49d4fa-275c-4afa-9dd0-0e71801cafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:24:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Volume volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 (9480cc55-4b5c-4270-a6fd-01cb7c877f65): created successfully Aug 19 00:24:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de49d4fa-275c-4afa-9dd0-0e71801cafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:24:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Flow 'volume_create_manager' (5b4e4e44-5c28-4b0c-807f-fb92df8b8d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:24:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-46d6f536-e296-45fb-9197-ab83176ac772 tempest-TestStampPattern-1543783778 None] Created volume successfully. Aug 19 00:24:54 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:24:54 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=1 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:13 devstack sudo[113796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:25:13 devstack sudo[113796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:13 devstack sudo[113796]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:25:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:25:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-28d2aaa5-6806-4171-b41e-9bbf5ca634fd req-bcd1a437-c3a9-4985-83f8-cc6f11dfd984 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:25:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-28d2aaa5-6806-4171-b41e-9bbf5ca634fd req-bcd1a437-c3a9-4985-83f8-cc6f11dfd984 tempest-TestStampPattern-1543783778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:25:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [req-28d2aaa5-6806-4171-b41e-9bbf5ca634fd req-bcd1a437-c3a9-4985-83f8-cc6f11dfd984 tempest-TestStampPattern-1543783778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:25:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-28d2aaa5-6806-4171-b41e-9bbf5ca634fd req-bcd1a437-c3a9-4985-83f8-cc6f11dfd984 tempest-TestStampPattern-1543783778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768', 'name': 'volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6134a0d8-c4fa-431d-8739-2b59ca4b0d21', 'enforce_multipath': True} {{(pid=94243) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 19 00:25:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-28d2aaa5-6806-4171-b41e-9bbf5ca634fd req-bcd1a437-c3a9-4985-83f8-cc6f11dfd984 tempest-TestStampPattern-1543783778 None] attachment_update completed successfully. Aug 19 00:25:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [req-8d364587-6f17-4556-bb28-5f0295908460 req-2e56ad96-7944-457c-9358-26ee84e1831e tempest-TestStampPattern-1543783778 None] Terminate volume connection completed successfully. Aug 19 00:25:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [req-8d364587-6f17-4556-bb28-5f0295908460 req-2e56ad96-7944-457c-9358-26ee84e1831e tempest-TestStampPattern-1543783778 None] Deleting attachment 6134a0d8-c4fa-431d-8739-2b59ca4b0d21. {{(pid=94243) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 19 00:25:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-9480cc55-4b5c-4270-a6fd-01cb7c877f65-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Lock "cinder-9480cc55-4b5c-4270-a6fd-01cb7c877f65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-quobyte-9480cc55-4b5c-4270-a6fd-01cb7c877f65" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-9480cc55-4b5c-4270-a6fd-01cb7c877f65" acquired by "delete_volume" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1d5ef-4ae5-4566-b452-c3b84d98a5bb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:25:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:33 devstack sudo[114410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 Aug 19 00:25:33 devstack sudo[114410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:34 devstack sudo[114410]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65" returned: 0 in 0.361s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:34 devstack sudo[114415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65 Aug 19 00:25:34 devstack sudo[114415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:34 devstack sudo[114415]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9480cc55-4b5c-4270-a6fd-01cb7c877f65" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-9480cc55-4b5c-4270-a6fd-01cb7c877f65" released by "delete_volume" :: held 0.639s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Created reservations ['d09c93b9-ecf5-44a3-93c4-bba53fb76504', 'c9bedf49-b45a-4df7-ac5a-a6ef3a411c97', 'ac48ad6f-1a71-4353-b5c6-421650ebb28d', '06c69e31-0114-40c9-9308-26cf4e9a41b0'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:34 devstack sudo[114418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:25:34 devstack sudo[114418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:34 devstack sudo[114418]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.249s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:25:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Deleted volume successfully. Aug 19 00:25:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-62e49aef-0499-4af7-8dfc-7ad35a5c3532 tempest-TestStampPattern-1543783778 None] Lock "cinder-9480cc55-4b5c-4270-a6fd-01cb7c877f65-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-209971ac-cead-4176-b43b-ed02dbca603e-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Lock "cinder-209971ac-cead-4176-b43b-ed02dbca603e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-quobyte-34e3930d-f88e-4530-aceb-193bfdd4c86c" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-34e3930d-f88e-4530-aceb-193bfdd4c86c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-quobyte-209971ac-cead-4176-b43b-ed02dbca603e" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-209971ac-cead-4176-b43b-ed02dbca603e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Deleting offline snapshot 209971ac-cead-4176-b43b-ed02dbca603e of volume 34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] snapshot_file for this snap is: volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d3ffc4-9cfc-4206-8be4-2f7105900be1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:35 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e Aug 19 00:25:35 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:35 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e" returned: 0 in 0.346s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e3930d-f88e-4530-aceb-193bfdd4c86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca154f9a-7a86-4c0b-96cf-fb56c758c0a4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:25:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:35 devstack sudo[114426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c Aug 19 00:25:35 devstack sudo[114426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:36 devstack sudo[114426]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c" returned: 0 in 0.515s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:36 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e Aug 19 00:25:36 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:36 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:36 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e Aug 19 00:25:36 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:36 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c.209971ac-cead-4176-b43b-ed02dbca603e" returned: 0 in 0.247s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-209971ac-cead-4176-b43b-ed02dbca603e" released by "_delete_snapshot" :: held 1.511s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-34e3930d-f88e-4530-aceb-193bfdd4c86c" released by "delete_snapshot" :: held 1.533s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Created reservations ['b03a8de9-ccfa-460a-a174-2c8fa3c82426', '12166011-597d-40f1-84b2-b6cf46afb9ad', '5da72fe2-4ba9-402e-a5bd-1ddadbc192a5', 'fa8ceb87-ca67-471c-b2da-8bcaf5461b6d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:25:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Delete snapshot completed successfully. Aug 19 00:25:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8407e66-2338-471a-b731-1c743972edae tempest-TestStampPattern-1543783778 None] Lock "cinder-209971ac-cead-4176-b43b-ed02dbca603e-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-34e3930d-f88e-4530-aceb-193bfdd4c86c-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Lock "cinder-34e3930d-f88e-4530-aceb-193bfdd4c86c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Acquiring lock "cinder-quobyte-34e3930d-f88e-4530-aceb-193bfdd4c86c" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:25:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-34e3930d-f88e-4530-aceb-193bfdd4c86c" acquired by "delete_volume" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:25:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[60605df2-7770-4594-81df-a4f4844e070f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:25:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:40 devstack sudo[114469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c Aug 19 00:25:40 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:41 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c" returned: 0 in 0.353s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:41 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c Aug 19 00:25:41 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:41 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-34e3930d-f88e-4530-aceb-193bfdd4c86c" returned: 0 in 0.236s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Lock "cinder-quobyte-34e3930d-f88e-4530-aceb-193bfdd4c86c" released by "delete_volume" :: held 0.642s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Created reservations ['dc4185a1-9b4c-4aee-a744-7019e9cbd472', 'a2ebda2f-ea89-4177-baf7-e7b5a81995dc', '64b1fc63-42bb-4369-a8b6-16cae94f65f9', 'e9c264f7-5f2d-406d-a0af-90f330f7b607'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:25:41 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:25:41 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:25:41 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.244s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:25:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Deleted volume successfully. Aug 19 00:25:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-55d1211d-4c2a-4b97-96cd-5327ee028bb2 tempest-TestStampPattern-1543783778 None] Lock "cinder-34e3930d-f88e-4530-aceb-193bfdd4c86c-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:25:51 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:25:51 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=20,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (ffd965d6-423b-454b-8f87-4017101164c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5539c8-bd33-4962-8f62-f8e8c4f2ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5539c8-bd33-4962-8f62-f8e8c4f2ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862456504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f1dd6a-d0b6-4ec5-b784-85d1ee887480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:10Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f358ea2-c70a-4844-b568-ed5d0a889558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f358ea2-c70a-4844-b568-ed5d0a889558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d813bc4f-fe6d-462a-83ca-c85669584187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d813bc4f-fe6d-462a-83ca-c85669584187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f1dd6a-d0b6-4ec5-b784-85d1ee887480', 'volume_name': 'volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b64e5aa-ae64-4484-b9dc-78022c739074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b64e5aa-ae64-4484-b9dc-78022c739074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7caf32-545f-4dbe-a2dc-11795881ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume d4f1dd6a-d0b6-4ec5-b784-85d1ee887480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480', 'volume_size': 1} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862456504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f1dd6a-d0b6-4ec5-b784-85d1ee887480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:10Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Creating volume d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:10 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:10 devstack sudo[114531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 1073741824 Aug 19 00:26:10 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (0c4e30de-27ff-45ad-9f84-205b7af76946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1dbf89e-ad59-4f64-85b8-dc102f38afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1dbf89e-ad59-4f64-85b8-dc102f38afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2083654190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626b464f-d5cf-41c8-b1ca-73d3df33f083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:10Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75685974-db89-4cbf-ac45-595775d40b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75685974-db89-4cbf-ac45-595775d40b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971294a3-2ef8-4953-a3f7-524e8d59d1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971294a3-2ef8-4953-a3f7-524e8d59d1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626b464f-d5cf-41c8-b1ca-73d3df33f083', 'volume_name': 'volume-626b464f-d5cf-41c8-b1ca-73d3df33f083', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81737a83-5db6-467c-916e-68ff9de99f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81737a83-5db6-467c-916e-68ff9de99f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2fcd26-86d8-4fd1-9b31-4fcbd05c2362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Volume 626b464f-d5cf-41c8-b1ca-73d3df33f083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626b464f-d5cf-41c8-b1ca-73d3df33f083', 'volume_size': 1} Aug 19 00:26:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (a28fb452-6de4-4476-962f-7ad19fb6e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655b54d0-14e4-4073-9712-8bc50f776407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655b54d0-14e4-4073-9712-8bc50f776407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234284253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8af150d-bfdd-483c-bdd4-1c825a9c0808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:11Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631ea3c2-ca04-4768-b713-d5da1569ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631ea3c2-ca04-4768-b713-d5da1569ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6188c7a-5732-491d-b860-6d3e5f4fc15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6188c7a-5732-491d-b860-6d3e5f4fc15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8af150d-bfdd-483c-bdd4-1c825a9c0808', 'volume_name': 'volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648986c8-5063-4b9a-9b58-d3cce8361f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648986c8-5063-4b9a-9b58-d3cce8361f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581cbbae-faa0-4b28-b1ae-30e9a6506156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Volume e8af150d-bfdd-483c-bdd4-1c825a9c0808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808', 'volume_size': 1} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 1073741824" returned: 0 in 0.679s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Flow 'volume_create_manager' (ad0a6570-a145-4e9b-b8d3-760e441815d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cea0889-156c-4c52-a25b-92a7050296d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cea0889-156c-4c52-a25b-92a7050296d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1074780178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf8abea268c4772bfb4e8505336a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:11Z,use_quota=True,user_id='9d238e370e9d4c1ca5afab16e9a58f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd40ce35-40a1-4dc8-8429-95f0051c4136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd40ce35-40a1-4dc8-8429-95f0051c4136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74abfd65-27e5-413e-b23a-90f0f44399a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74abfd65-27e5-413e-b23a-90f0f44399a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e', 'volume_name': 'volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d69180-085b-4941-99de-5ab508cd7946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d69180-085b-4941-99de-5ab508cd7946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ce572f-66b2-49f3-9445-9776acb53671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Volume 99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e', 'volume_size': 1} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (f18e1146-0ca4-4f84-8e14-830835c739d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0364555b-b2ea-49a0-a6f3-a7ef15885433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:11 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0364555b-b2ea-49a0-a6f3-a7ef15885433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1976140955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:11Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a3829-5a9e-4aa5-a079-12c0c2cf29c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a3829-5a9e-4aa5-a079-12c0c2cf29c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52cfe83-3a84-4d3e-a59f-92a34761140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52cfe83-3a84-4d3e-a59f-92a34761140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e', 'volume_name': 'volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f29433e-a2fd-4a40-80f8-41d6a6496423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f29433e-a2fd-4a40-80f8-41d6a6496423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bb4c7a-b6f5-47c8-adb9-ed09fb854a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Volume 25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e', 'volume_size': 1} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:11 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (141ef336-6ae7-4bc6-9b8a-0109d7c279f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5abee7-61a9-46d4-b065-603661add463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2083654190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626b464f-d5cf-41c8-b1ca-73d3df33f083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:10Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Creating volume 626b464f-d5cf-41c8-b1ca-73d3df33f083 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5abee7-61a9-46d4-b065-603661add463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975037572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd97b7f-0b81-4f1d-8cb3-971c7e37655a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:12Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack sudo[114543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 1073741824 Aug 19 00:26:11 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd5a699-18e9-4945-a63d-11f39f968965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd5a699-18e9-4945-a63d-11f39f968965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc78888-fba0-4604-9697-02a38bc17edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc78888-fba0-4604-9697-02a38bc17edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd97b7f-0b81-4f1d-8cb3-971c7e37655a', 'volume_name': 'volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fe7c02-dbc0-40e2-90bc-c3ff161edb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fe7c02-dbc0-40e2-90bc-c3ff161edb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f087b39-d549-4d2e-a74e-b63e9fac219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Volume 1cd97b7f-0b81-4f1d-8cb3-971c7e37655a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a', 'volume_size': 1} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7caf32-545f-4dbe-a2dc-11795881ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24afaa0-221b-41d0-8740-333f1e3022cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 (d4f1dd6a-d0b6-4ec5-b784-85d1ee887480): created successfully Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24afaa0-221b-41d0-8740-333f1e3022cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (ffd965d6-423b-454b-8f87-4017101164c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-be691055-149b-4b92-bf76-5d2c20669012 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created volume successfully. Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:11 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (d764c660-c994-4b16-a94d-78d481e5f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc82c3ff-690f-4a8e-a685-d21fa3657278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc82c3ff-690f-4a8e-a685-d21fa3657278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2020583238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ba95bb-76c2-4ec5-bdfd-3124b432fdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:12Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abb2f9e-81e7-4ecb-9a12-2d140e12ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abb2f9e-81e7-4ecb-9a12-2d140e12ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3de6377-671c-4075-92d6-7aa2ec70813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3de6377-671c-4075-92d6-7aa2ec70813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ba95bb-76c2-4ec5-bdfd-3124b432fdd3', 'volume_name': 'volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b709cba-8bdd-4acd-ae58-8f101609dd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b709cba-8bdd-4acd-ae58-8f101609dd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d4d90-c216-4615-927b-19e11f0dda5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Volume 24ba95bb-76c2-4ec5-bdfd-3124b432fdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3', 'volume_size': 1} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:12 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 1073741824" returned: 0 in 0.541s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:12 devstack sudo[114550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 Aug 19 00:26:12 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:12 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083" returned: 0 in 0.267s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234284253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8af150d-bfdd-483c-bdd4-1c825a9c0808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:11Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Creating volume e8af150d-bfdd-483c-bdd4-1c825a9c0808 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:12 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2fcd26-86d8-4fd1-9b31-4fcbd05c2362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626b464f-d5cf-41c8-b1ca-73d3df33f083', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb2f8b8-4d02-403b-a562-b1d8677890f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Volume volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 (626b464f-d5cf-41c8-b1ca-73d3df33f083): created successfully Aug 19 00:26:12 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 1073741824 Aug 19 00:26:12 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb2f8b8-4d02-403b-a562-b1d8677890f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (0c4e30de-27ff-45ad-9f84-205b7af76946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:12 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bf90400f-942e-4aab-b739-1f0ce06baf2a tempest-CreateVolumesFromImageTest-146870330 None] Created volume successfully. Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (35b9f5a5-caeb-4506-bac6-d6c1b70bc9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9ca14a-6423-41af-a523-153cd0df0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9ca14a-6423-41af-a523-153cd0df0052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872209368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a570f4bc-e860-4a79-afd1-4aee95c2cd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:13Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd314a79-b56e-4c8a-9713-355805e7167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd314a79-b56e-4c8a-9713-355805e7167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc8c343-3a41-4921-89fe-171c59d1f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc8c343-3a41-4921-89fe-171c59d1f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a570f4bc-e860-4a79-afd1-4aee95c2cd5b', 'volume_name': 'volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b63f491-e656-49d7-b8c3-c82db1efe92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b63f491-e656-49d7-b8c3-c82db1efe92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30eeee0-49f8-4c17-8a2a-d44ca1aeb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:12 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume a570f4bc-e860-4a79-afd1-4aee95c2cd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b', 'volume_size': 1} Aug 19 00:26:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:13 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (9af187d0-331d-449f-a32a-fa472fa18287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3258390e-70c1-4a07-8e9e-921e386b7ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 1073741824" returned: 0 in 0.692s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3258390e-70c1-4a07-8e9e-921e386b7ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926601166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786bfb21-08bb-4261-93bb-5d9ee443641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:13Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464a172d-cdbc-4ec3-808e-125e63a225a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464a172d-cdbc-4ec3-808e-125e63a225a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba88c34-3831-43ed-ae6d-f906ee0df371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba88c34-3831-43ed-ae6d-f906ee0df371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786bfb21-08bb-4261-93bb-5d9ee443641b', 'volume_name': 'volume-786bfb21-08bb-4261-93bb-5d9ee443641b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16a47e6-af4e-424f-8417-70c190392598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16a47e6-af4e-424f-8417-70c190392598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94139dc-6afa-41c7-970d-69bffd37ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume 786bfb21-08bb-4261-93bb-5d9ee443641b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786bfb21-08bb-4261-93bb-5d9ee443641b', 'volume_size': 1} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:13 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 Aug 19 00:26:13 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:13 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:13 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:13 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (284803c1-b1b2-4c67-a370-e821bbab7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660883a5-5a6c-4d53-b77b-1f408f557a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808" returned: 0 in 0.432s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.490s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1074780178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf8abea268c4772bfb4e8505336a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:11Z,use_quota=True,user_id='9d238e370e9d4c1ca5afab16e9a58f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Creating volume 99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:13 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:13 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:13 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e 1073741824 Aug 19 00:26:13 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581cbbae-faa0-4b28-b1ae-30e9a6506156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f202c649-b54c-4c40-9278-80938a796c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660883a5-5a6c-4d53-b77b-1f408f557a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217906495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61963085-c046-49fa-8d26-287b960bc98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:14Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8bf7bb-e48e-4a86-a7c5-0ac44f331b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8bf7bb-e48e-4a86-a7c5-0ac44f331b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec844a3-7997-45a6-809a-2ddcc61a4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec844a3-7997-45a6-809a-2ddcc61a4a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61963085-c046-49fa-8d26-287b960bc98a', 'volume_name': 'volume-61963085-c046-49fa-8d26-287b960bc98a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66375cc8-8396-40c8-921b-4e64a7336cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66375cc8-8396-40c8-921b-4e64a7336cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ec44a7-aa40-4058-8dee-4ead29dc1228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:13 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume 61963085-c046-49fa-8d26-287b960bc98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61963085-c046-49fa-8d26-287b960bc98a', 'volume_size': 1} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:26:13 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Volume volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 (e8af150d-bfdd-483c-bdd4-1c825a9c0808): created successfully Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f202c649-b54c-4c40-9278-80938a796c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (a28fb452-6de4-4476-962f-7ad19fb6e150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ba797c0a-3934-4f2c-91ce-22ceaaff941c tempest-CreateVolumesFromImageTest-146870330 None] Created volume successfully. Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (587559e5-3016-4c47-ad41-52195d2754e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edd036a-27fe-4305-bd98-374e90194e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0edd036a-27fe-4305-bd98-374e90194e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358032538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd807dc2-83fa-45ec-89aa-9a54062957c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:14Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d21ac8e-3aac-422e-b160-b7eea235c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d21ac8e-3aac-422e-b160-b7eea235c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d95510-69be-4c3d-8b0d-29c764f30e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d95510-69be-4c3d-8b0d-29c764f30e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd807dc2-83fa-45ec-89aa-9a54062957c3', 'volume_name': 'volume-dd807dc2-83fa-45ec-89aa-9a54062957c3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff656458-8b24-4067-9d39-11623dba798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff656458-8b24-4067-9d39-11623dba798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36809d62-b718-42eb-9424-a5bf7b24a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume dd807dc2-83fa-45ec-89aa-9a54062957c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd807dc2-83fa-45ec-89aa-9a54062957c3', 'volume_size': 1} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e 1073741824" returned: 0 in 0.532s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:14 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e Aug 19 00:26:14 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:14 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" returned: 0 in 0.341s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1976140955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:11Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Creating volume 25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:14 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:14 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e 1073741824 Aug 19 00:26:14 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (f01963c9-9c46-4cd2-85ff-aaeadc93f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217b0042-3540-4db1-bf53-48c0e80326df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ce572f-66b2-49f3-9445-9776acb53671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ac9844-56ad-4382-8fcf-16f6bc762ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217b0042-3540-4db1-bf53-48c0e80326df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987124137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16efac84-74df-403d-b702-69005d8d1a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:15Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d942fd8-a0a1-41c9-80d0-a05c2e16f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d942fd8-a0a1-41c9-80d0-a05c2e16f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fc558f-1459-4901-a019-417774fb8a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fc558f-1459-4901-a019-417774fb8a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16efac84-74df-403d-b702-69005d8d1a17', 'volume_name': 'volume-16efac84-74df-403d-b702-69005d8d1a17', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605c555e-1c0c-4754-9682-ff357c448f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605c555e-1c0c-4754-9682-ff357c448f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f57e42f-a380-4f14-9a27-cf2b4ea41412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume 16efac84-74df-403d-b702-69005d8d1a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16efac84-74df-403d-b702-69005d8d1a17', 'volume_size': 1} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Volume volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e (99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e): created successfully Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ac9844-56ad-4382-8fcf-16f6bc762ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Flow 'volume_create_manager' (ad0a6570-a145-4e9b-b8d3-760e441815d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:14 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9ac7b06a-6176-4372-8926-03ac35aaac68 tempest-VolumeDependencyTests-1654969669 None] Created volume successfully. Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Flow 'volume_create_manager' (c9adee33-5556-4afd-b6ed-c01fa7993a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4ba5c4-8bd3-4eee-952a-bfe88c29e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4ba5c4-8bd3-4eee-952a-bfe88c29e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9671f7-4012-4040-bf41-e1ac03883667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1de2ffcbf141c7ae22046401fbb95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:15Z,use_quota=True,user_id='9092b01352b94c819d6560d82fa95ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d4c8232-4b40-4c92-80a8-40b2f6482d02),volume_type_id=2d4c8232-4b40-4c92-80a8-40b2f6482d02)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36e2e75-1296-46fa-8c15-51f119869a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36e2e75-1296-46fa-8c15-51f119869a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34368fec-6977-401e-863f-8e8c4a7f6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:14 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:26:15 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e 1073741824" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:15 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e Aug 19 00:26:15 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34368fec-6977-401e-863f-8e8c4a7f6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb9671f7-4012-4040-bf41-e1ac03883667', 'volume_name': 'volume-fb9671f7-4012-4040-bf41-e1ac03883667', 'volume_size': 1, 'image_id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52b62145-d6b0-4c84-87e9-20ec13561823', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74e83ae7e4028eaa1bfaedb0e2f28a13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de1de2ffcbf141c7ae22046401fbb95f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e9a149c3882a9fa8b882ce79e64c6fb70350730f9d19ae178566a425a8755ff620baa6ffa736f64d2d9a16bb551c6a242e7382f445f1052d0f938e3e5151396', 'id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'created_at': datetime.datetime(2026, 8, 18, 22, 26, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 26, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52b62145-d6b0-4c84-87e9-20ec13561823/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40713c2f-121f-44dd-9040-1c457ff02d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40713c2f-121f-44dd-9040-1c457ff02d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8382158-1a17-4161-bfd8-5ddbf87918f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Volume fb9671f7-4012-4040-bf41-e1ac03883667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb9671f7-4012-4040-bf41-e1ac03883667', 'volume_size': 1, 'image_id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52b62145-d6b0-4c84-87e9-20ec13561823', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74e83ae7e4028eaa1bfaedb0e2f28a13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de1de2ffcbf141c7ae22046401fbb95f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e9a149c3882a9fa8b882ce79e64c6fb70350730f9d19ae178566a425a8755ff620baa6ffa736f64d2d9a16bb551c6a242e7382f445f1052d0f938e3e5151396', 'id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'created_at': datetime.datetime(2026, 8, 18, 22, 26, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 26, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52b62145-d6b0-4c84-87e9-20ec13561823/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Trying to clone fb9671f7-4012-4040-bf41-e1ac03883667 from image 52b62145-d6b0-4c84-87e9-20ec13561823 at location (None, [{'url': 'file:///opt/stack/data/glance/images/52b62145-d6b0-4c84-87e9-20ec13561823', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:26:15 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Image download 0.00 MB at 0.00 MB/s Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5312c-f2c4-49b3-9383-82725c4a0d98]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:15 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975037572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd97b7f-0b81-4f1d-8cb3-971c7e37655a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:12Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Creating volume 1cd97b7f-0b81-4f1d-8cb3-971c7e37655a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:15 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bb4c7a-b6f5-47c8-adb9-ed09fb854a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:15 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a 1073741824 Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8264592b-9df2-46df-ad1e-1fbf1e9d58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:15 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Volume volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e (25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e): created successfully Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8264592b-9df2-46df-ad1e-1fbf1e9d58ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (f18e1146-0ca4-4f84-8e14-830835c739d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a6975eb8-b03a-481e-9f5e-e89c0a17c01d tempest-CreateVolumesFromImageTest-146870330 None] Created volume successfully. Aug 19 00:26:15 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD Aug 19 00:26:15 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:15 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:15 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a 1073741824" returned: 0 in 0.439s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:15 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD Aug 19 00:26:15 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:15 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a Aug 19 00:26:16 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:16 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Temporary image 52b62145-d6b0-4c84-87e9-20ec13561823 is fetched for user 9092b01352b94c819d6560d82fa95ab0. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:26:16 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a" returned: 0 in 0.261s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.174s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2020583238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ba95bb-76c2-4ec5-bdfd-3124b432fdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3bf325c28e42bca88150b88dbdbd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:12Z,use_quota=True,user_id='514ef758d0084df5a284f3f9225c6e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Creating volume 24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:16 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f087b39-d549-4d2e-a74e-b63e9fac219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:16 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 1073741824 Aug 19 00:26:16 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c1e37a-3c37-4f80-af58-d783ffc4fc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:16 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Volume volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a (1cd97b7f-0b81-4f1d-8cb3-971c7e37655a): created successfully Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c1e37a-3c37-4f80-af58-d783ffc4fc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (141ef336-6ae7-4bc6-9b8a-0109d7c279f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7710cf5-4405-4b1d-a99e-83c88bc75378]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:16 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-979d4779-7826-423b-ae25-d8c4fd7350f1 tempest-CreateVolumesFromImageTest-146870330 None] Created volume successfully. Aug 19 00:26:16 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD Aug 19 00:26:16 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:16 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:16 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 1073741824" returned: 0 in 0.433s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:16 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 Aug 19 00:26:16 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:16 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD Aug 19 00:26:16 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:17 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3" returned: 0 in 0.279s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.118s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872209368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a570f4bc-e860-4a79-afd1-4aee95c2cd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:13Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Creating volume a570f4bc-e860-4a79-afd1-4aee95c2cd5b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:17 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:17 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d4d90-c216-4615-927b-19e11f0dda5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:17 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b 1073741824 Aug 19 00:26:17 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f75f270-a5b5-4c87-8998-bf15cfb883c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Volume volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 (24ba95bb-76c2-4ec5-bdfd-3124b432fdd3): created successfully Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f75f270-a5b5-4c87-8998-bf15cfb883c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Flow 'volume_create_manager' (d764c660-c994-4b16-a94d-78d481e5f808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bf192b13-c625-43a0-84c2-b908227a4c02 tempest-CreateVolumesFromImageTest-146870330 None] Created volume successfully. Aug 19 00:26:17 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b 1073741824" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:17 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b Aug 19 00:26:17 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:17 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.464s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926601166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786bfb21-08bb-4261-93bb-5d9ee443641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:13Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Creating volume 786bfb21-08bb-4261-93bb-5d9ee443641b {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:17 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:17 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b 1073741824 Aug 19 00:26:17 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30eeee0-49f8-4c17-8a2a-d44ca1aeb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c3cb46-c6c2-46d9-9395-d91be8624427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:17 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b (a570f4bc-e860-4a79-afd1-4aee95c2cd5b): created successfully Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c3cb46-c6c2-46d9-9395-d91be8624427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (35b9f5a5-caeb-4506-bac6-d6c1b70bc9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8c6d39c2-33a6-44f5-bd80-00767f465325 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created volume successfully. Aug 19 00:26:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-quobyte-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959af34-ccc0-49d9-af90-879bd94104e2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:18 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b 1073741824" returned: 0 in 0.435s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:18 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 Aug 19 00:26:18 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:18 devstack sudo[114670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b Aug 19 00:26:18 devstack sudo[114670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:18 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3" returned: 0 in 0.394s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:18 devstack sudo[114670]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b" returned: 0 in 0.251s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.583s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217906495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61963085-c046-49fa-8d26-287b960bc98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:14Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Creating volume 61963085-c046-49fa-8d26-287b960bc98a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:18 devstack sudo[114677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3 Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:18 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:18 devstack sudo[114677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:18 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a 1073741824 Aug 19 00:26:18 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94139dc-6afa-41c7-970d-69bffd37ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786bfb21-08bb-4261-93bb-5d9ee443641b', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2cfbaa-9e03-4123-9b7b-403a5851e66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:18 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume volume-786bfb21-08bb-4261-93bb-5d9ee443641b (786bfb21-08bb-4261-93bb-5d9ee443641b): created successfully Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2cfbaa-9e03-4123-9b7b-403a5851e66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (9af187d0-331d-449f-a32a-fa472fa18287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:18 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-048c1598-3f6a-4765-8345-4092d176bb4d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created volume successfully. Aug 19 00:26:18 devstack sudo[114677]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3" returned: 0 in 0.271s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3" released by "delete_volume" :: held 0.704s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Created reservations ['8c43896b-cf25-4582-beb6-0258b2aa0605', 'fadaaa43-1053-4111-9c09-e66434c4ed13', 'c89b2a45-9a6c-4950-8aba-50cb8f9a43e9', '83af7982-51e9-410d-b761-904d2a7bc3b4'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:18 devstack sudo[114686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:18 devstack sudo[114686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:19 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a 1073741824" returned: 0 in 0.518s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:19 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a Aug 19 00:26:19 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:19 devstack sudo[114686]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.270s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Deleted volume successfully. Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e62ef71a-ad89-46ca-bda5-764ee9f1ae04 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-24ba95bb-76c2-4ec5-bdfd-3124b432fdd3-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-quobyte-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[53527f6c-ca07-4d0e-8a61-6c25af293e04]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:19 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a" returned: 0 in 0.281s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.041s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358032538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd807dc2-83fa-45ec-89aa-9a54062957c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:14Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Creating volume dd807dc2-83fa-45ec-89aa-9a54062957c3 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:19 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ec44a7-aa40-4058-8dee-4ead29dc1228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61963085-c046-49fa-8d26-287b960bc98a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:19 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a Aug 19 00:26:19 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba230e1-0562-40c9-b916-35e02c3f5bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:19 devstack sudo[114693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 1073741824 Aug 19 00:26:19 devstack sudo[114693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume volume-61963085-c046-49fa-8d26-287b960bc98a (61963085-c046-49fa-8d26-287b960bc98a): created successfully Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba230e1-0562-40c9-b916-35e02c3f5bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (284803c1-b1b2-4c67-a370-e821bbab7f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3c94493b-8361-4cfa-9b65-9a9841833ab1 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created volume successfully. Aug 19 00:26:19 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:19 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a Aug 19 00:26:19 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:19 devstack sudo[114693]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 1073741824" returned: 0 in 0.446s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:19 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 Aug 19 00:26:19 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:19 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a" released by "delete_volume" :: held 0.680s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Created reservations ['6109a081-072f-48a3-b129-4bbff3ad4fd7', '0653883a-bf1f-4188-bb54-dfa3ed177118', '8b3f8daf-be08-425b-a201-17f2b3fad3c2', '077a47a5-fc9e-4bdf-929d-01e928791a9a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:20 devstack sudo[114709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:20 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:20 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.299s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987124137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16efac84-74df-403d-b702-69005d8d1a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2870bc9305d49e19d59dc8e106b95f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:15Z,use_quota=True,user_id='7414d649d56c46cf92a26d3417c36382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Creating volume 16efac84-74df-403d-b702-69005d8d1a17 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:20 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36809d62-b718-42eb-9424-a5bf7b24a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd807dc2-83fa-45ec-89aa-9a54062957c3', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:20 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 1073741824 Aug 19 00:26:20 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46135074-9e37-4b3e-90bf-8ee23a6b12e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 (dd807dc2-83fa-45ec-89aa-9a54062957c3): created successfully Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46135074-9e37-4b3e-90bf-8ee23a6b12e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (587559e5-3016-4c47-ad41-52195d2754e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6f7cf949-3079-4f75-abf6-7d669315faea tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created volume successfully. Aug 19 00:26:20 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Deleted volume successfully. Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2c99c06d-20ee-4f79-b234-115cd32e94e8 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-1cd97b7f-0b81-4f1d-8cb3-971c7e37655a-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-quobyte-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ff523f-0cdc-4753-9dcf-e654f77439b3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:20 devstack sudo[114717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e Aug 19 00:26:20 devstack sudo[114717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:20 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 1073741824" returned: 0 in 0.470s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:20 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 Aug 19 00:26:20 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:20 devstack sudo[114717]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e" returned: 0 in 0.355s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:20 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e Aug 19 00:26:20 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:20 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.540s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f57e42f-a380-4f14-9a27-cf2b4ea41412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16efac84-74df-403d-b702-69005d8d1a17', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a1911a-a2ed-47ab-b164-6e987497cdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Creating offline snapshot ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 of volume 99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:26:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Volume volume-16efac84-74df-403d-b702-69005d8d1a17 (16efac84-74df-403d-b702-69005d8d1a17): created successfully Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a1911a-a2ed-47ab-b164-6e987497cdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Flow 'volume_create_manager' (f01963c9-9c46-4cd2-85ff-aaeadc93f99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d133cd1-7d9d-4f37-9154-97bc99c5ad3c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-61aca0af-6a1c-4289-bf84-bd2c784cf21d tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created volume successfully. Aug 19 00:26:21 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e" released by "delete_volume" :: held 0.661s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:21 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e Aug 19 00:26:21 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Created reservations ['50c16090-9446-4a5c-9d02-1de1c9ca98d1', '07668fcd-736b-49b1-9a89-3e1384e9aadb', 'e01f7712-12c9-4e4b-bdb4-9babc0be41b8', 'bb272ca2-7b07-455c-94da-fdb7efc79f4d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:21 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:21 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:21 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" returned: 0 in 0.380s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:21 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 1G Aug 19 00:26:21 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:21 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Deleted volume successfully. Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-209f5ffd-7318-4a78-aa07-469a0cec317b tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-25bbbb7b-09d4-42a3-9ecc-fdb253d4e99e-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-16efac84-74df-403d-b702-69005d8d1a17-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-e8af150d-bfdd-483c-bdd4-1c825a9c0808-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-16efac84-74df-403d-b702-69005d8d1a17-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-e8af150d-bfdd-483c-bdd4-1c825a9c0808-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-quobyte-16efac84-74df-403d-b702-69005d8d1a17" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-quobyte-e8af150d-bfdd-483c-bdd4-1c825a9c0808" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-16efac84-74df-403d-b702-69005d8d1a17" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-e8af150d-bfdd-483c-bdd4-1c825a9c0808" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1df0e00-f547-4cb5-a9c8-a1ea92dae3e0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44e2a47-123d-429c-875f-1501799ad65e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:21 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 Aug 19 00:26:21 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:21 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 1G" returned: 0 in 0.461s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:21 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 Aug 19 00:26:21 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:21 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 Aug 19 00:26:21 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17" returned: 0 in 0.395s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808" returned: 0 in 0.395s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17 Aug 19 00:26:22 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" returned: 0 in 0.320s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 is being set with open permissions: ugo+rw Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack sudo[114759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808 Aug 19 00:26:22 devstack sudo[114759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 Aug 19 00:26:22 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-16efac84-74df-403d-b702-69005d8d1a17" returned: 0 in 0.261s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-16efac84-74df-403d-b702-69005d8d1a17" released by "delete_volume" :: held 0.705s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:22 devstack sudo[114759]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e8af150d-bfdd-483c-bdd4-1c825a9c0808" returned: 0 in 0.271s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-e8af150d-bfdd-483c-bdd4-1c825a9c0808" released by "delete_volume" :: held 0.714s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack sudo[114767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info Aug 19 00:26:22 devstack sudo[114767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created reservations ['b72b4f5e-3fcc-47ff-9dfe-d4a626cf28f5', 'de3b1c1c-2a83-4623-b87e-ff317bbb1b1f', 'c598678d-4448-4cf4-b8b5-1b0e8d6229aa', 'b0d6c102-4465-4366-b162-ad4db35e6d4e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Created reservations ['a976bed0-7520-4587-be4b-63df63cfaf57', '54f0bdc4-50a5-4bb4-8b02-cfb00913360f', '973eadeb-5266-4e14-80cb-91164befa1f4', '8750d0dc-b197-4c1e-aedb-d48fbb71178f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:22 devstack sudo[114769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:22 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack sudo[114771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:22 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack sudo[114767]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-626b464f-d5cf-41c8-b1ca-73d3df33f083-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-dd807dc2-83fa-45ec-89aa-9a54062957c3-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info" returned: 0 in 0.338s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info is being set with open permissions: ugo+rw Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-626b464f-d5cf-41c8-b1ca-73d3df33f083-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:22 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info Aug 19 00:26:22 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-dd807dc2-83fa-45ec-89aa-9a54062957c3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "cinder-quobyte-626b464f-d5cf-41c8-b1ca-73d3df33f083" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-quobyte-dd807dc2-83fa-45ec-89aa-9a54062957c3" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-626b464f-d5cf-41c8-b1ca-73d3df33f083" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:22 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-dd807dc2-83fa-45ec-89aa-9a54062957c3" acquired by "delete_volume" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.380s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Deleted volume successfully. Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f0fb6-11b0-4887-9fae-4e19e9e768f6]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba7da6-dec0-4c32-8655-8292c4065941]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-3fac73d7-4027-4c58-9f4e-7fadc9f48b80 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-16efac84-74df-403d-b702-69005d8d1a17-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:23 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.425s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Deleted volume successfully. Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-551eb5bd-431c-4c6c-b2f5-ddecffe6f426 tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-e8af150d-bfdd-483c-bdd4-1c825a9c0808-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:23 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.info" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 Aug 19 00:26:23 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:23 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 Aug 19 00:26:23 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.070s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9671f7-4012-4040-bf41-e1ac03883667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1de2ffcbf141c7ae22046401fbb95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:15Z,use_quota=True,user_id='9092b01352b94c819d6560d82fa95ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d4c8232-4b40-4c92-80a8-40b2f6482d02),volume_type_id=2d4c8232-4b40-4c92-80a8-40b2f6482d02)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Creating volume fb9671f7-4012-4040-bf41-e1ac03883667 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:23 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:23 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 1073741824 Aug 19 00:26:23 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0fffbe0b-eecc-4be0-b92a-1d8e72463ef8 tempest-VolumeDependencyTests-1654969669 None] Create snapshot completed successfully Aug 19 00:26:23 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083" returned: 0 in 0.441s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:23 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3" returned: 0 in 0.445s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:23 devstack sudo[114794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083 Aug 19 00:26:23 devstack sudo[114794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3 Aug 19 00:26:23 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 1073741824" returned: 0 in 0.425s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:23 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 Aug 19 00:26:23 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack sudo[114794]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-626b464f-d5cf-41c8-b1ca-73d3df33f083" returned: 0 in 0.301s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-dd807dc2-83fa-45ec-89aa-9a54062957c3" returned: 0 in 0.295s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-quobyte-626b464f-d5cf-41c8-b1ca-73d3df33f083" released by "delete_volume" :: held 0.809s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-dd807dc2-83fa-45ec-89aa-9a54062957c3" released by "delete_volume" :: held 0.808s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Created reservations ['d56d8a58-0f3d-4f2e-a543-43abf7e2816a', 'e007ed2e-266a-4ed3-9d67-d396d53a7ce2', '6f7c5c03-2dd6-4967-906d-a9dca4fff30c', 'd15cb21a-d2d1-41e4-b6c9-9a64ac286d94'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created reservations ['541a915e-7d85-4319-bed5-218e167ca8f9', 'cf46e16a-26c7-4e95-82a7-a3c7c7d9467b', 'bc2f8c46-a8fc-4252-b31b-4bacf21269b8', 'f2b66279-a4ce-4855-b44b-530c6bba5a2d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:23 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667" returned: 0 in 0.317s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:23 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:23 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Attempting download of 52b62145-d6b0-4c84-87e9-20ec13561823 ((None, [{'url': 'file:///opt/stack/data/glance/images/52b62145-d6b0-4c84-87e9-20ec13561823', 'metadata': {}}])) to volume fb9671f7-4012-4040-bf41-e1ac03883667. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-61963085-c046-49fa-8d26-287b960bc98a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:24 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:24 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-61963085-c046-49fa-8d26-287b960bc98a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e70d6b-5f68-459e-98e8-4ac377704193]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:24 devstack sudo[114808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702 Aug 19 00:26:24 devstack sudo[114808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-quobyte-61963085-c046-49fa-8d26-287b960bc98a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:24 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.466s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Deleted volume successfully. Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-61963085-c046-49fa-8d26-287b960bc98a" acquired by "delete_volume" :: waited 0.043s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:24 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.414s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Deleted volume successfully. Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6d5866a4-fac4-4619-a321-7feff832c9cc tempest-CreateVolumesFromImageTest-146870330 None] Lock "cinder-626b464f-d5cf-41c8-b1ca-73d3df33f083-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff9884a-7e05-4029-96e9-5a18dc568fad]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-cabfbdb7-feb7-480c-a787-9a1d5c957197 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-dd807dc2-83fa-45ec-89aa-9a54062957c3-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:24 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a Aug 19 00:26:24 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:24 devstack sudo[114808]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702" returned: 0 in 0.532s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Flow 'volume_create_manager' (df8717b9-7773-4ae6-9383-7d6c069cf3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc619abe-5bc4-4329-b936-22ab3f036f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc619abe-5bc4-4329-b936-22ab3f036f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1260471071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1b12d4-fe6a-413d-a54f-0f5c4e38240b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf8abea268c4772bfb4e8505336a4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:25Z,use_quota=True,user_id='9d238e370e9d4c1ca5afab16e9a58f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac9e10f-998e-4304-8ed7-cec970d559c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac9e10f-998e-4304-8ed7-cec970d559c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204d6749-adf8-4981-8866-495959bd7f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204d6749-adf8-4981-8866-495959bd7f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b1b12d4-fe6a-413d-a54f-0f5c4e38240b', 'volume_name': 'volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b', 'volume_size': 1, 'snapshot_id': 'ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f7f586-88f6-48e9-80e4-7b69a44c7f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f7f586-88f6-48e9-80e4-7b69a44c7f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540d9afb-dc59-43fd-bb86-dda4560a0f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:24 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Volume 9b1b12d4-fe6a-413d-a54f-0f5c4e38240b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b', 'volume_size': 1, 'snapshot_id': 'ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749'} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-quobyte-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:24 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702 Aug 19 00:26:24 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Creating volume 9b1b12d4-fe6a-413d-a54f-0f5c4e38240b from snapshot ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-quobyte-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] snapshot: ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749, volume: 9b1b12d4-fe6a-413d-a54f-0f5c4e38240b, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b5115-66a4-44b1-9b1f-aac86da97625]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:24 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a" returned: 0 in 0.504s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:25 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a Aug 19 00:26:25 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 Aug 19 00:26:25 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702" returned: 1 in 0.425s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_52b62145-d6b0-4c84-87e9-20ec13561823_7zn3s702' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b6da9f-50e8-4a94-afed-2edf0b86b9bb]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:25 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD Aug 19 00:26:25 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-61963085-c046-49fa-8d26-287b960bc98a" returned: 0 in 0.367s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-61963085-c046-49fa-8d26-287b960bc98a" released by "delete_volume" :: held 0.972s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:25 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created reservations ['737b04f4-0213-4a8c-b214-92dd726f9c16', '089cb987-8181-4695-871a-9a43ea200ad3', '4e111c94-78c9-4247-8b94-f974a9a963dc', 'e7406f6b-0b21-40d4-b113-e330d875967a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" returned: 0 in 0.506s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05707ff-0446-4897-85ab-d8e48afe2fcf]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:25 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:25 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e Aug 19 00:26:25 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:25 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD Aug 19 00:26:25 devstack sudo[114842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.286s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:25 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Deleted volume successfully. Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" returned: 0 in 0.446s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:25 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-90eeea50-c20c-4986-a386-9271389df622 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-61963085-c046-49fa-8d26-287b960bc98a-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:25 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:25 devstack sudo[114842]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] 52b62145-d6b0-4c84-87e9-20ec13561823 was raw, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:26:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:26 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 Aug 19 00:26:26 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-786bfb21-08bb-4261-93bb-5d9ee443641b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-786bfb21-08bb-4261-93bb-5d9ee443641b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-quobyte-786bfb21-08bb-4261-93bb-5d9ee443641b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-786bfb21-08bb-4261-93bb-5d9ee443641b" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53f0e5-a94f-4bcc-b716-ceb6a2e3ee68]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:26 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667" returned: 0 in 0.675s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_52b62145-d6b0-4c84-87e9-20ec13561823_b51sjo6ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:26:26 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Converted 0.00 MB image at 0.00 MB/s Aug 19 00:26:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:26 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b Aug 19 00:26:26 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:26 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 1G Aug 19 00:26:26 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:27 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b" returned: 0 in 1.129s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:27 devstack sudo[114886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b Aug 19 00:26:27 devstack sudo[114886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:27 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 1G" returned: 0 in 1.127s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Downloaded image 52b62145-d6b0-4c84-87e9-20ec13561823 ((None, [{'url': 'file:///opt/stack/data/glance/images/52b62145-d6b0-4c84-87e9-20ec13561823', 'metadata': {}}])) to volume fb9671f7-4012-4040-bf41-e1ac03883667 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Temporary image 52b62145-d6b0-4c84-87e9-20ec13561823 for user 9092b01352b94c819d6560d82fa95ab0 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Marking volume fb9671f7-4012-4040-bf41-e1ac03883667 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Copying metadata from image 52b62145-d6b0-4c84-87e9-20ec13561823 to fb9671f7-4012-4040-bf41-e1ac03883667. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:26:27 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Creating volume glance metadata for volume fb9671f7-4012-4040-bf41-e1ac03883667 backed by image 52b62145-d6b0-4c84-87e9-20ec13561823 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '74e83ae7e4028eaa1bfaedb0e2f28a13', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8382158-1a17-4161-bfd8-5ddbf87918f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9671f7-4012-4040-bf41-e1ac03883667', 'volume_size': 1, 'image_id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/52b62145-d6b0-4c84-87e9-20ec13561823', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74e83ae7e4028eaa1bfaedb0e2f28a13', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de1de2ffcbf141c7ae22046401fbb95f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e9a149c3882a9fa8b882ce79e64c6fb70350730f9d19ae178566a425a8755ff620baa6ffa736f64d2d9a16bb551c6a242e7382f445f1052d0f938e3e5151396', 'id': '52b62145-d6b0-4c84-87e9-20ec13561823', 'created_at': datetime.datetime(2026, 8, 18, 22, 26, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 26, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/52b62145-d6b0-4c84-87e9-20ec13561823/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b081166-7c28-4cbe-9a3a-5533be2b9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:28 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Volume volume-fb9671f7-4012-4040-bf41-e1ac03883667 (fb9671f7-4012-4040-bf41-e1ac03883667): created successfully Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b081166-7c28-4cbe-9a3a-5533be2b9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Flow 'volume_create_manager' (c9adee33-5556-4afd-b6ed-c01fa7993a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-07b3009c-6c64-4fff-888d-47765653b9e5 tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Created volume successfully. Aug 19 00:26:28 devstack sudo[114886]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-786bfb21-08bb-4261-93bb-5d9ee443641b" returned: 0 in 0.685s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-786bfb21-08bb-4261-93bb-5d9ee443641b" released by "delete_volume" :: held 1.889s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created reservations ['f4fdc7da-58de-497f-91e0-ba6a4b7fc4d2', '9729c244-6f44-494e-88e5-8563f9bee771', 'a75b4e7b-696d-4f2d-b271-0810d8a980b2', 'b50efa2f-8ebb-4bf0-8602-59bede290860'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:28 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:28 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-a570f4bc-e860-4a79-afd1-4aee95c2cd5b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-a570f4bc-e860-4a79-afd1-4aee95c2cd5b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:28 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Flow 'volume_create_manager' (b5a9edb7-9230-4cbe-bff3-f6209175e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de387c07-d3b5-4fd2-a29d-ff3dc332ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Acquiring lock "cinder-fb9671f7-4012-4040-bf41-e1ac03883667-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-quobyte-a570f4bc-e860-4a79-afd1-4aee95c2cd5b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de387c07-d3b5-4fd2-a29d-ff3dc332ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db383fe8-d4ee-4a77-be55-ccd2b343791f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb8d7d55e441eba5ed162304d136f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:29Z,use_quota=True,user_id='3439aed0f9cd4eb19294c89d84408daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe30ef6-9e88-4b85-8acf-50a24eb7e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe30ef6-9e88-4b85-8acf-50a24eb7e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41db949-699f-45cc-9b4a-4c0ed48aa9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41db949-699f-45cc-9b4a-4c0ed48aa9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db383fe8-d4ee-4a77-be55-ccd2b343791f', 'volume_name': 'volume-db383fe8-d4ee-4a77-be55-ccd2b343791f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1cf6b6-3901-472f-b854-6c96a98d9d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1cf6b6-3901-472f-b854-6c96a98d9d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a5f86c-6b8a-4a2a-814c-c7dfee112ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Volume db383fe8-d4ee-4a77-be55-ccd2b343791f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db383fe8-d4ee-4a77-be55-ccd2b343791f', 'volume_size': 1} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-a570f4bc-e860-4a79-afd1-4aee95c2cd5b" acquired by "delete_volume" :: waited 0.157s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "cinder-fb9671f7-4012-4040-bf41-e1ac03883667-delete_volume" acquired by "delete_volume" :: waited 0.220s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a3b888-d01a-4412-bab2-f42c6cb40d8e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:29 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.733s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Deleted volume successfully. Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Acquiring lock "cinder-quobyte-fb9671f7-4012-4040-bf41-e1ac03883667" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "cinder-quobyte-fb9671f7-4012-4040-bf41-e1ac03883667" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b5f0fa1a-dbb0-415a-a125-a52b000ade7a tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-786bfb21-08bb-4261-93bb-5d9ee443641b-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ef7d5-fc31-4f31-a40d-a7dae34c54a4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:29 devstack sudo[114894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b Aug 19 00:26:29 devstack sudo[114894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:29 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 Aug 19 00:26:29 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:30 devstack sudo[114894]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b" returned: 0 in 0.938s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:30 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b Aug 19 00:26:30 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:30 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667" returned: 0 in 1.005s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:30 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667 Aug 19 00:26:30 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:30 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a570f4bc-e860-4a79-afd1-4aee95c2cd5b" returned: 0 in 0.477s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-a570f4bc-e860-4a79-afd1-4aee95c2cd5b" released by "delete_volume" :: held 1.526s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:30 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created reservations ['3615a1da-e9cd-4273-9aaf-516e44b6e7f4', '93fa51e1-683b-4b20-9d3e-909a49a91757', 'ed07bc73-42d6-4f64-9d8f-c9ae7231d632', '1d8264f4-fb62-464f-b0ec-8c740299397a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:31 devstack sudo[114911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:31 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:31 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fb9671f7-4012-4040-bf41-e1ac03883667" returned: 0 in 0.835s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "cinder-quobyte-fb9671f7-4012-4040-bf41-e1ac03883667" released by "delete_volume" :: held 2.002s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "cinder-quobyte-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Created reservations ['5e2ce82e-a120-49d7-8fd4-7e5e7ebe3e4e', '4efeb37b-58a1-4aff-a505-4b26331d5049', '833f1345-7d8a-42a9-87a8-50fe29489958', '4b18c802-1ecc-486b-b6ed-8df702552fff'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ffbbe-dd34-4372-bcde-f321f664afee]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:31 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" returned: 0 in 5.761s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:26:31 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Converted 1024.00 MB image at 177.72 MB/s Aug 19 00:26:31 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b is being set with open permissions: ugo+rw Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:31 devstack sudo[114914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b Aug 19 00:26:31 devstack sudo[114914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:31 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.614s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:31 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Deleted volume successfully. Aug 19 00:26:31 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 Aug 19 00:26:31 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:31 devstack sudo[114917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:31 devstack sudo[114917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e8b5391a-e9d0-4257-8206-69a078902746 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-a570f4bc-e860-4a79-afd1-4aee95c2cd5b-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:32 devstack sudo[114914]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" returned: 0 in 0.304s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" released by "_copy_volume_from_snapshot" :: held 7.110s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:32 devstack sudo[114917]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.293s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" released by "_create_volume_from_snapshot" :: held 7.201s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.218s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db383fe8-d4ee-4a77-be55-ccd2b343791f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb8d7d55e441eba5ed162304d136f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:29Z,use_quota=True,user_id='3439aed0f9cd4eb19294c89d84408daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Creating volume db383fe8-d4ee-4a77-be55-ccd2b343791f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:32 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:32 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Deleted volume successfully. Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480" returned: 0 in 0.438s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:32 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f 1073741824 Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:32 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:32 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480 Aug 19 00:26:32 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540d9afb-dc59-43fd-bb86-dda4560a0f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b', 'volume_size': 1, 'snapshot_id': 'ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede64e2c-c13f-405f-8150-55abe3897578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5d152954-35bd-47c5-be8a-8ed86d8c31bb tempest-VolumeAndVolumeTypeFromImageTest-1833986195 None] Lock "cinder-fb9671f7-4012-4040-bf41-e1ac03883667-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:32 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Volume volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b (9b1b12d4-fe6a-413d-a54f-0f5c4e38240b): created successfully Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede64e2c-c13f-405f-8150-55abe3897578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Flow 'volume_create_manager' (df8717b9-7773-4ae6-9383-7d6c069cf3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-282d9246-0376-4882-a096-2e73514a84e9 tempest-VolumeDependencyTests-1654969669 None] Created volume successfully. Aug 19 00:26:32 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480" returned: 0 in 0.334s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-quobyte-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480" released by "delete_volume" :: held 0.830s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-quobyte-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-quobyte-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Deleting offline snapshot ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 of volume 99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] snapshot_file for this snap is: volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac18aab-fe65-4256-80ca-2eb54833956c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Created reservations ['a07d2b1e-1b79-4417-b553-f9fe6f80d72c', '78c762d9-3d48-4b15-a545-ef94bf0dc74e', 'e9bb1c9d-c863-46ac-939c-1185a07414a1', '681e7095-1074-42ab-ac62-9cf0dec6273c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:32 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f 1073741824" returned: 0 in 0.581s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:32 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 Aug 19 00:26:32 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:32 devstack sudo[114937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:32 devstack sudo[114937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:32 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f Aug 19 00:26:32 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:33 devstack sudo[114937]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.361s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:33 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Deleted volume successfully. Aug 19 00:26:33 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" returned: 0 in 0.509s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f" returned: 0 in 0.345s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[023eddea-36f7-4af5-97e8-75f60b2a436a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2fb86acb-ecb5-4986-8b92-4e5582cc0283 tempest-CreateVolumesFromSourceVolumeTest-537793530 None] Lock "cinder-d4f1dd6a-d0b6-4ec5-b784-85d1ee887480-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a5f86c-6b8a-4a2a-814c-c7dfee112ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db383fe8-d4ee-4a77-be55-ccd2b343791f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dce7d8a-f268-4b42-893f-84a791611e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:33 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Volume volume-db383fe8-d4ee-4a77-be55-ccd2b343791f (db383fe8-d4ee-4a77-be55-ccd2b343791f): created successfully Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dce7d8a-f268-4b42-893f-84a791611e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Flow 'volume_create_manager' (b5a9edb7-9230-4cbe-bff3-f6209175e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1c1d03d1-cb11-46d6-8191-ce571e078eb7 tempest-CinderUnicodeTest-1495240214 None] Created volume successfully. Aug 19 00:26:33 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e Aug 19 00:26:33 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:33 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" returned: 0 in 0.592s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:33 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 Aug 19 00:26:33 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:34 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" returned: 0 in 0.414s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:34 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749 Aug 19 00:26:34 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:34 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e.ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" returned: 0 in 0.344s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749" released by "_delete_snapshot" :: held 2.006s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" released by "delete_snapshot" :: held 2.045s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Created reservations ['5e71be73-8cce-48a3-a470-8cd65f779873', '8ed12b1b-8a40-4793-bb75-b780808487af', '37820446-ff7e-4753-9795-848ccadeb757', '62a1b0a1-3018-4b78-bca1-ecc96b7ec251'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Delete snapshot completed successfully. Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e419dd7b-dcf1-4f29-97a3-e40c786692e2 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-ca0db7a7-3a66-4b3f-ae9d-5b5eed9a4749-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Flow 'volume_create_manager' (55e3c267-fd3f-44ad-b0c9-1fd5d1ce9a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef103ce5-3dd4-4eb3-9a0b-7d9e50779e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef103ce5-3dd4-4eb3-9a0b-7d9e50779e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-890202456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90128cbb-70b3-4066-94e8-89a6c8ac2c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb8d7d55e441eba5ed162304d136f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:35Z,use_quota=True,user_id='3439aed0f9cd4eb19294c89d84408daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a3642f-75df-44c6-adcd-03864b54958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a3642f-75df-44c6-adcd-03864b54958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbacce9f-7062-4765-9587-7d2385cd0f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbacce9f-7062-4765-9587-7d2385cd0f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90128cbb-70b3-4066-94e8-89a6c8ac2c66', 'volume_name': 'volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512eb4d7-bc21-4bb8-ae16-5bbc097d08a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512eb4d7-bc21-4bb8-ae16-5bbc097d08a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377c4833-922a-4c63-b545-df0e98ed0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Volume 90128cbb-70b3-4066-94e8-89a6c8ac2c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66', 'volume_size': 1} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-890202456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90128cbb-70b3-4066-94e8-89a6c8ac2c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb8d7d55e441eba5ed162304d136f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:35Z,use_quota=True,user_id='3439aed0f9cd4eb19294c89d84408daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Creating volume 90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:34 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:34 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 1073741824 Aug 19 00:26:34 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:35 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 1073741824" returned: 0 in 0.526s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:35 devstack sudo[114967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 Aug 19 00:26:35 devstack sudo[114967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-quobyte-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:35 devstack sudo[114967]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a1dfed-a303-4349-aa06-4bde1984232a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377c4833-922a-4c63-b545-df0e98ed0647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc605dc2-9bbd-483b-81c0-bb155ccbe4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Volume volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 (90128cbb-70b3-4066-94e8-89a6c8ac2c66): created successfully Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc605dc2-9bbd-483b-81c0-bb155ccbe4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Flow 'volume_create_manager' (55e3c267-fd3f-44ad-b0c9-1fd5d1ce9a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-28d96e0e-0c22-4ff0-939d-5644f4a2d081 tempest-CinderUnicodeTest-1495240214 None] Created volume successfully. Aug 19 00:26:36 devstack sudo[114970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e Aug 19 00:26:36 devstack sudo[114970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:36 devstack sudo[114970]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" returned: 0 in 0.425s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:36 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e Aug 19 00:26:36 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:36 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e" released by "delete_volume" :: held 0.744s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Created reservations ['2398b032-d160-4d8e-b7c9-6013272e22f8', 'bcca913f-3a4e-4aa0-a95a-c11815f0c1ef', '09c25bfb-b423-4742-9d45-f379fc04b69c', '83238b59-f07f-4b26-bc79-0f5016135fcd'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:36 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:36 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "cinder-quobyte-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:37 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.326s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" acquired by "delete_volume" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:37 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Deleted volume successfully. Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d32abe6f-996c-45a6-ba19-3cb6f3227201 tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-99eb7c6d-3849-4e58-a2ff-7e7f8c67ef0e-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b60c384-2c79-430c-b8c4-03d7fbc1b2e2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:37 devstack sudo[114981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b Aug 19 00:26:37 devstack sudo[114981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Creating offline snapshot 80de616e-6187-41d1-9e93-a9e4affa862d of volume 90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ef54e1-b04e-4951-8636-f3dfac17a996]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:37 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 Aug 19 00:26:37 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:37 devstack sudo[114981]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" returned: 0 in 0.511s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:37 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b Aug 19 00:26:37 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:37 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66" returned: 0 in 0.505s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:37 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d 1G Aug 19 00:26:37 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (a66fce1b-1375-4bdb-8bd7-e9af595b71cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:37 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad6dc4f-11b2-4b8c-b2ce-55e77736223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" returned: 0 in 0.315s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad6dc4f-11b2-4b8c-b2ce-55e77736223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461007238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a92a81-a7ca-43b7-af93-b7268b0f5149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:38Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0f9308-1baf-44df-b6d7-55be76675bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0f9308-1baf-44df-b6d7-55be76675bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0b5149-32d0-44f7-95fb-88874d528b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0b5149-32d0-44f7-95fb-88874d528b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a92a81-a7ca-43b7-af93-b7268b0f5149', 'volume_name': 'volume-86a92a81-a7ca-43b7-af93-b7268b0f5149', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41db29cd-4254-4b67-80f9-29877b6c6e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41db29cd-4254-4b67-80f9-29877b6c6e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bccd7bc-bafe-49ea-891a-902c286ae7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:37 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume 86a92a81-a7ca-43b7-af93-b7268b0f5149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a92a81-a7ca-43b7-af93-b7268b0f5149', 'volume_size': 1} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-quobyte-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b" released by "delete_volume" :: held 0.940s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Created reservations ['562a6419-60d5-43d2-bf79-ee39e6918959', 'f696e912-6f64-415b-ae0a-dde2fe2c36e6', '0e6ee428-44c7-4336-b663-08000d89667c', 'c170cbda-18b1-4a91-8bb3-64cc95cb56bd'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:38 devstack sudo[115000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:38 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:38 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d 1G" returned: 0 in 0.539s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:38 devstack sudo[115002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d Aug 19 00:26:38 devstack sudo[115002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:38 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.277s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Deleted volume successfully. Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c8a55eac-a20f-42d9-8885-87d8db37b92e tempest-VolumeDependencyTests-1654969669 None] Lock "cinder-9b1b12d4-fe6a-413d-a54f-0f5c4e38240b-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:38 devstack sudo[115002]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d" returned: 0 in 0.325s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:38 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d is being set with open permissions: ugo+rw Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:38 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d Aug 19 00:26:38 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:38 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d" returned: 0 in 0.253s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:39 devstack sudo[115012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info Aug 19 00:26:39 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:39 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:39 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info is being set with open permissions: ugo+rw Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:39 devstack sudo[115015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info Aug 19 00:26:39 devstack sudo[115015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Flow 'volume_create_manager' (75183c2e-1663-4943-bd7c-90055bfbf66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81bb2ef-4b9c-422a-9a93-c5f9708c555c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81bb2ef-4b9c-422a-9a93-c5f9708c555c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e781b88-fc79-4635-9fb2-71667a528953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2349234e9a014792854a9105eac8552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:39Z,use_quota=True,user_id='19185e61555d4f069c47321934a5c347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158da54d-0097-4b77-9826-8bcda9d3df5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158da54d-0097-4b77-9826-8bcda9d3df5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2bc2ad-604a-487f-8c8c-347aaae02a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.image.glance [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Creating Keystone auth plugin from conf {{(pid=94243) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 19 00:26:39 devstack sudo[115015]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.info" returned: 0 in 0.276s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461007238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a92a81-a7ca-43b7-af93-b7268b0f5149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:38Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating volume 86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:39 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:39 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 1073741824 Aug 19 00:26:39 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e34984fa-8730-4acc-a1e7-b616166c7ff3 tempest-CinderUnicodeTest-1495240214 None] Create snapshot completed successfully Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2bc2ad-604a-487f-8c8c-347aaae02a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e781b88-fc79-4635-9fb2-71667a528953', 'volume_name': 'volume-3e781b88-fc79-4635-9fb2-71667a528953', 'volume_size': 1, 'image_id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f8938a4-0cc7-4254-9d69-cf707879ac59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2aa404ed1d294f20d313d86e3720ebe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2349234e9a014792854a9105eac8552c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd499622a54f4331bf8e955ae515aa9aac79eec782f406d68a2421c3c4b10ae91adef7dc9cdfffd800c4fdbc6090b30d81977a44d9573f0283b07e904cdbe8b78', 'id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'created_at': datetime.datetime(2026, 8, 18, 22, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f8938a4-0cc7-4254-9d69-cf707879ac59/file', 'properties': {}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d429a9f9-d92d-4a45-a77e-972a61c69960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d429a9f9-d92d-4a45-a77e-972a61c69960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e999e0-8253-4bde-aa31-713cbe6108dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Volume 3e781b88-fc79-4635-9fb2-71667a528953: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e781b88-fc79-4635-9fb2-71667a528953', 'volume_size': 1, 'image_id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f8938a4-0cc7-4254-9d69-cf707879ac59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2aa404ed1d294f20d313d86e3720ebe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2349234e9a014792854a9105eac8552c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd499622a54f4331bf8e955ae515aa9aac79eec782f406d68a2421c3c4b10ae91adef7dc9cdfffd800c4fdbc6090b30d81977a44d9573f0283b07e904cdbe8b78', 'id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'created_at': datetime.datetime(2026, 8, 18, 22, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f8938a4-0cc7-4254-9d69-cf707879ac59/file', 'properties': {}}, 'image_service': } Aug 19 00:26:39 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Trying to clone 3e781b88-fc79-4635-9fb2-71667a528953 from image 1f8938a4-0cc7-4254-9d69-cf707879ac59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f8938a4-0cc7-4254-9d69-cf707879ac59', 'metadata': {}}]). {{(pid=94243) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 19 00:26:40 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Image download 0.00 MB at 0.00 MB/s Aug 19 00:26:40 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 1073741824" returned: 0 in 0.548s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bdb950-fafb-4373-adfe-5cde9e67a39a]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:40 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 Aug 19 00:26:40 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:40 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD Aug 19 00:26:40 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-80de616e-6187-41d1-9e93-a9e4affa862d-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:40 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-80de616e-6187-41d1-9e93-a9e4affa862d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-quobyte-90128cbb-70b3-4066-94e8-89a6c8ac2c66" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:40 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149" returned: 0 in 0.366s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-90128cbb-70b3-4066-94e8-89a6c8ac2c66" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-quobyte-80de616e-6187-41d1-9e93-a9e4affa862d" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bccd7bc-bafe-49ea-891a-902c286ae7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a92a81-a7ca-43b7-af93-b7268b0f5149', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c6f34b-df3d-4529-b69c-feacafa15c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-80de616e-6187-41d1-9e93-a9e4affa862d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Deleting offline snapshot 80de616e-6187-41d1-9e93-a9e4affa862d of volume 90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] snapshot_file for this snap is: volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:26:40 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 (86a92a81-a7ca-43b7-af93-b7268b0f5149): created successfully Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c6f34b-df3d-4529-b69c-feacafa15c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (a66fce1b-1375-4bdb-8bd7-e9af595b71cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:40 devstack sudo[115031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD Aug 19 00:26:40 devstack sudo[115031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca98a6-a9d2-42e1-8630-871f699f3403]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4da39407-35b8-4e00-ae8d-75cd21c8cd5f tempest-CreateVolumesFromSnapshotTest-543995605 None] Created volume successfully. Aug 19 00:26:40 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d Aug 19 00:26:40 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:40 devstack sudo[115031]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Temporary image 1f8938a4-0cc7-4254-9d69-cf707879ac59 is fetched for user 19185e61555d4f069c47321934a5c347. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8519e27-3b5d-4c03-b12e-76bcde1bd49e]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:41 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD Aug 19 00:26:41 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:41 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d" returned: 0 in 0.478s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4cc9a-ef9e-46f3-9faa-ef83d6777346]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:41 devstack sudo[115045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 Aug 19 00:26:41 devstack sudo[115045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating offline snapshot ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 of volume 86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83dad8d-a8cb-418a-93e8-bd0d21997f8c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:41 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:41 devstack sudo[115049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 Aug 19 00:26:41 devstack sudo[115049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:41 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD Aug 19 00:26:41 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:41 devstack sudo[115045]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66" returned: 0 in 0.470s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:41 devstack sudo[115056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d Aug 19 00:26:41 devstack sudo[115056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:41 devstack sudo[115049]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149" returned: 0 in 0.449s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:41 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:41 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 1G Aug 19 00:26:41 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:42 devstack sudo[115056]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d" returned: 0 in 0.398s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:42 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d Aug 19 00:26:42 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:42 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66.80de616e-6187-41d1-9e93-a9e4affa862d" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:42 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 1G" returned: 0 in 0.467s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-80de616e-6187-41d1-9e93-a9e4affa862d" released by "_delete_snapshot" :: held 1.756s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-90128cbb-70b3-4066-94e8-89a6c8ac2c66" released by "delete_snapshot" :: held 1.803s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:42 devstack sudo[115078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 Aug 19 00:26:42 devstack sudo[115078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Created reservations ['8e373ec9-d049-4330-9496-74282210a7d2', '316349ec-e9b2-4720-9760-7f870c6d5fed', '507e16d3-b141-46e4-b436-d9dcb353a067', 'b51d6fd2-feab-44d3-95a7-6a1c4cc76ab9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Delete snapshot completed successfully. Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a9c383c0-e528-4073-8f2c-18f03a397ce1 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-80de616e-6187-41d1-9e93-a9e4affa862d-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:42 devstack sudo[115078]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-90128cbb-70b3-4066-94e8-89a6c8ac2c66-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:42 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 is being set with open permissions: ugo+rw Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:42 devstack sudo[115083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-90128cbb-70b3-4066-94e8-89a6c8ac2c66-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:42 devstack sudo[115083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-quobyte-90128cbb-70b3-4066-94e8-89a6c8ac2c66" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-90128cbb-70b3-4066-94e8-89a6c8ac2c66" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611fcb0-3568-418a-9717-7fbb36087586]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:42 devstack sudo[115085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 Aug 19 00:26:42 devstack sudo[115085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:42 devstack sudo[115083]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:43 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info Aug 19 00:26:43 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:43 devstack sudo[115085]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66" returned: 0 in 0.410s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:43 devstack sudo[115094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66 Aug 19 00:26:43 devstack sudo[115094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:43 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info" returned: 0 in 0.274s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:43 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info is being set with open permissions: ugo+rw Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:43 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info Aug 19 00:26:43 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:43 devstack sudo[115094]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-90128cbb-70b3-4066-94e8-89a6c8ac2c66" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-90128cbb-70b3-4066-94e8-89a6c8ac2c66" released by "delete_volume" :: held 0.759s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:43 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.info" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e781b88-fc79-4635-9fb2-71667a528953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2349234e9a014792854a9105eac8552c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:39Z,use_quota=True,user_id='19185e61555d4f069c47321934a5c347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Creating volume 3e781b88-fc79-4635-9fb2-71667a528953 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:43 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:43 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 1073741824 Aug 19 00:26:43 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e689cb6d-1445-409a-841f-b5fb12bea613 tempest-CreateVolumesFromSnapshotTest-543995605 None] Create snapshot completed successfully Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Created reservations ['2faecc3f-a1ff-455c-9818-af2f739ec574', 'cdb2aca3-b942-4036-8318-923f06d4f1ff', '1e4c1553-5960-45a2-9fae-d5e726fc36d0', 'f5e6dbc2-43d9-4417-af65-2bde93cef6b8'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:43 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:43 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-db383fe8-d4ee-4a77-be55-ccd2b343791f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-db383fe8-d4ee-4a77-be55-ccd2b343791f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "cinder-quobyte-db383fe8-d4ee-4a77-be55-ccd2b343791f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-db383fe8-d4ee-4a77-be55-ccd2b343791f" acquired by "delete_volume" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[32efef7a-cec8-4d92-a215-88b2c8fc5bcb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:44 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.363s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Deleted volume successfully. Aug 19 00:26:44 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 1073741824" returned: 0 in 0.543s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8dbe74ac-cdda-44d6-bb13-5db38bc82944 tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-90128cbb-70b3-4066-94e8-89a6c8ac2c66-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:44 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 Aug 19 00:26:44 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:44 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f Aug 19 00:26:44 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:44 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953" returned: 0 in 0.270s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Attempting download of 1f8938a4-0cc7-4254-9d69-cf707879ac59 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f8938a4-0cc7-4254-9d69-cf707879ac59', 'metadata': {}}])) to volume 3e781b88-fc79-4635-9fb2-71667a528953. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 19 00:26:44 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f" returned: 0 in 0.444s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e75a75a-2de7-462a-89e0-5a2c2201c8c1]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:44 devstack sudo[115117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f Aug 19 00:26:44 devstack sudo[115117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:44 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr Aug 19 00:26:44 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:44 devstack sudo[115117]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-db383fe8-d4ee-4a77-be55-ccd2b343791f" returned: 0 in 0.359s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-quobyte-db383fe8-d4ee-4a77-be55-ccd2b343791f" released by "delete_volume" :: held 0.863s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:44 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr" returned: 0 in 0.406s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (17ea94bf-0042-4184-abd2-ec33df13b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527cd8aa-e0bd-442d-9f82-7215dad6f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527cd8aa-e0bd-442d-9f82-7215dad6f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957841364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64e966b-7419-48b9-9ba9-4ecb122224cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:45Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79a6cff-4bb9-41eb-8513-ecd51f6728ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79a6cff-4bb9-41eb-8513-ecd51f6728ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c90e73e-b072-4357-a2d4-c820d2e317b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c90e73e-b072-4357-a2d4-c820d2e317b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e64e966b-7419-48b9-9ba9-4ecb122224cc', 'volume_name': 'volume-e64e966b-7419-48b9-9ba9-4ecb122224cc', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedc0485-8d92-4c02-ac5e-ff834163bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedc0485-8d92-4c02-ac5e-ff834163bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack sudo[115124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr Aug 19 00:26:45 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18c45f0-5548-4b86-8022-68f844d041bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume e64e966b-7419-48b9-9ba9-4ecb122224cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e64e966b-7419-48b9-9ba9-4ecb122224cc', 'volume_size': 1} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957841364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e64e966b-7419-48b9-9ba9-4ecb122224cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:45Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating volume e64e966b-7419-48b9-9ba9-4ecb122224cc {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:45 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Created reservations ['8a233304-3436-440f-a29a-1a1ad26cd833', 'effa992b-b665-4ffb-99fa-9bfd340ae753', 'dc3870d5-f183-4eb3-bbd6-8d817f31b307', '3f608a2a-de58-4a7e-9d6f-149f1c75e655'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:45 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc 1073741824 Aug 19 00:26:45 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:45 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:45 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:45 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr" returned: 1 in 0.573s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f8938a4-0cc7-4254-9d69-cf707879ac59_r0cerwkr' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2003cdf-a5df-4018-92c8-cac935e78070]: (4, 'raw') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (bc490636-5154-48f8-8550-6a345ed068b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8a4d9e-0e52-43a1-a2f5-a0030b84177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack sudo[115135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD Aug 19 00:26:45 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8a4d9e-0e52-43a1-a2f5-a0030b84177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1341111600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f996c5-a9e5-42a0-9e64-cd44cfd413f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:46Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b98a580-53f8-4891-b8ee-fd8a2c6a2e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b98a580-53f8-4891-b8ee-fd8a2c6a2e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191d4047-783f-4143-935a-a366c7fd7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191d4047-783f-4143-935a-a366c7fd7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f996c5-a9e5-42a0-9e64-cd44cfd413f4', 'volume_name': 'volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5632e-9aa1-4d0d-96f1-298ba97ca558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e5632e-9aa1-4d0d-96f1-298ba97ca558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f6c49e-9426-47b1-aba4-ed1ce99a4e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:45 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume 47f996c5-a9e5-42a0-9e64-cd44cfd413f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4', 'volume_size': 1} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:45 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.506s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Deleted volume successfully. Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f5ff3470-6c17-4670-b82f-739ad157f7ad tempest-CinderUnicodeTest-1495240214 None] Lock "cinder-db383fe8-d4ee-4a77-be55-ccd2b343791f-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:45 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc 1073741824" returned: 0 in 0.805s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:46 devstack sudo[115140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc Aug 19 00:26:46 devstack sudo[115140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:46 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:46 devstack sudo[115140]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:46 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD Aug 19 00:26:46 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (324d3185-cb63-4b4a-baa7-778707253d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09136ad4-f383-4526-a508-a71da8469faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc" returned: 0 in 0.420s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1341111600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f996c5-a9e5-42a0-9e64-cd44cfd413f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:46Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating volume 47f996c5-a9e5-42a0-9e64-cd44cfd413f4 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:46 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09136ad4-f383-4526-a508-a71da8469faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167061620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c15c832-647a-43c3-9523-f3c1ca32921c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:46Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:46 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 1073741824 Aug 19 00:26:46 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416d86a3-f9f6-44a0-b479-af7ca2eac284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416d86a3-f9f6-44a0-b479-af7ca2eac284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fe71af-024d-4e7a-bd5f-0281a0686f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fe71af-024d-4e7a-bd5f-0281a0686f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c15c832-647a-43c3-9523-f3c1ca32921c', 'volume_name': 'volume-1c15c832-647a-43c3-9523-f3c1ca32921c', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfd499c-8e08-43fa-93d9-57995ec67568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfd499c-8e08-43fa-93d9-57995ec67568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cc33ad-a076-4c76-b345-409522f0547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume 1c15c832-647a-43c3-9523-f3c1ca32921c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c15c832-647a-43c3-9523-f3c1ca32921c', 'volume_size': 1} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18c45f0-5548-4b86-8022-68f844d041bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e64e966b-7419-48b9-9ba9-4ecb122224cc', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f61eaa-f32e-476f-a7e7-57d856f4fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:46 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume volume-e64e966b-7419-48b9-9ba9-4ecb122224cc (e64e966b-7419-48b9-9ba9-4ecb122224cc): created successfully Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f61eaa-f32e-476f-a7e7-57d856f4fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (17ea94bf-0042-4184-abd2-ec33df13b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0b3dac48-f2dc-4045-8175-ce8cd45942f8 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created volume successfully. Aug 19 00:26:46 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD" returned: 1 in 0.607s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] 1f8938a4-0cc7-4254-9d69-cf707879ac59 was raw, converting to qcow2 {{(pid=94243) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:46 devstack sudo[115153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 Aug 19 00:26:46 devstack sudo[115153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:46 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (e92fe50e-aa91-4eca-8155-c874fbf6032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0540f789-524c-45fd-9d90-97dcc780907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0540f789-524c-45fd-9d90-97dcc780907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1938984352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8e459b-37d4-4339-9f25-c7a10d179c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:47Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad6f596-70d9-45e9-a6a7-53410491c613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad6f596-70d9-45e9-a6a7-53410491c613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11349a9c-4632-4965-a90b-0dc95f31ce34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11349a9c-4632-4965-a90b-0dc95f31ce34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8e459b-37d4-4339-9f25-c7a10d179c62', 'volume_name': 'volume-6c8e459b-37d4-4339-9f25-c7a10d179c62', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3b4f45-bcf9-4906-8544-90f7bf5b93c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3b4f45-bcf9-4906-8544-90f7bf5b93c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7c04c6-42e2-4d6f-a42d-2e62aa5d2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume 6c8e459b-37d4-4339-9f25-c7a10d179c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8e459b-37d4-4339-9f25-c7a10d179c62', 'volume_size': 1} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:47 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 1073741824" returned: 0 in 0.685s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:47 devstack sudo[115161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 Aug 19 00:26:47 devstack sudo[115161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:47 devstack sudo[115153]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953" returned: 0 in 0.761s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f8938a4-0cc7-4254-9d69-cf707879ac59_vnff32zsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:26:47 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Converted 0.00 MB image at 0.00 MB/s Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:47 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 1G Aug 19 00:26:47 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:47 devstack sudo[115161]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4" returned: 0 in 0.464s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167061620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c15c832-647a-43c3-9523-f3c1ca32921c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:46Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating volume 1c15c832-647a-43c3-9523-f3c1ca32921c {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:47 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:47 devstack sudo[115167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c 1073741824 Aug 19 00:26:47 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (831cdcf1-09ce-411d-90ba-79ddecb0a5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa77d3a-15e1-4f8c-85dc-639d60ca6456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f6c49e-9426-47b1-aba4-ed1ce99a4e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dedb290-2df7-4534-97a0-e42416c7b654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa77d3a-15e1-4f8c-85dc-639d60ca6456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726377913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a1886-a5a1-40a5-a376-f15482094c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:48Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d39bad-4472-4cda-ae7f-2748496c435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d39bad-4472-4cda-ae7f-2748496c435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5718d775-d931-4f82-b8e2-f8ee4c1ef9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5718d775-d931-4f82-b8e2-f8ee4c1ef9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5a1886-a5a1-40a5-a376-f15482094c79', 'volume_name': 'volume-5c5a1886-a5a1-40a5-a376-f15482094c79', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78085e5f-5ede-4837-b147-881c7fa0c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78085e5f-5ede-4837-b147-881c7fa0c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102c4665-cd0f-4d9f-804a-bc17daf4c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume 5c5a1886-a5a1-40a5-a376-f15482094c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5a1886-a5a1-40a5-a376-f15482094c79', 'volume_size': 1} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 (47f996c5-a9e5-42a0-9e64-cd44cfd413f4): created successfully Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dedb290-2df7-4534-97a0-e42416c7b654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (bc490636-5154-48f8-8550-6a345ed068b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-72f24156-f95b-4522-b424-a0eded790e4d tempest-CreateVolumesFromSnapshotTest-543995605 None] Created volume successfully. Aug 19 00:26:48 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 1G" returned: 0 in 0.484s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Downloaded image 1f8938a4-0cc7-4254-9d69-cf707879ac59 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f8938a4-0cc7-4254-9d69-cf707879ac59', 'metadata': {}}])) to volume 3e781b88-fc79-4635-9fb2-71667a528953 successfully. {{(pid=94243) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Temporary image 1f8938a4-0cc7-4254-9d69-cf707879ac59 for user 19185e61555d4f069c47321934a5c347 is deleted. {{(pid=94243) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.volume_utils [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Marking volume 3e781b88-fc79-4635-9fb2-71667a528953 as bootable. {{(pid=94243) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Copying metadata from image 1f8938a4-0cc7-4254-9d69-cf707879ac59 to 3e781b88-fc79-4635-9fb2-71667a528953. {{(pid=94243) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Creating volume glance metadata for volume 3e781b88-fc79-4635-9fb2-71667a528953 backed by image 1f8938a4-0cc7-4254-9d69-cf707879ac59 with: {'image_id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2aa404ed1d294f20d313d86e3720ebe4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94243) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e999e0-8253-4bde-aa31-713cbe6108dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e781b88-fc79-4635-9fb2-71667a528953', 'volume_size': 1, 'image_id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f8938a4-0cc7-4254-9d69-cf707879ac59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2aa404ed1d294f20d313d86e3720ebe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2349234e9a014792854a9105eac8552c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd499622a54f4331bf8e955ae515aa9aac79eec782f406d68a2421c3c4b10ae91adef7dc9cdfffd800c4fdbc6090b30d81977a44d9573f0283b07e904cdbe8b78', 'id': '1f8938a4-0cc7-4254-9d69-cf707879ac59', 'created_at': datetime.datetime(2026, 8, 18, 22, 26, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 18, 22, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f8938a4-0cc7-4254-9d69-cf707879ac59/file', 'properties': {}}, 'image_service': }' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccec2ed3-268f-4262-beed-3e2a2214650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Volume volume-3e781b88-fc79-4635-9fb2-71667a528953 (3e781b88-fc79-4635-9fb2-71667a528953): created successfully Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccec2ed3-268f-4262-beed-3e2a2214650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Flow 'volume_create_manager' (75183c2e-1663-4943-bd7c-90055bfbf66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-98e74950-b716-42dd-a6b8-03365b574581 tempest-VolumeImageDependencyTests-1719698387 None] Created volume successfully. Aug 19 00:26:48 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c 1073741824" returned: 0 in 0.665s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:48 devstack sudo[115177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c Aug 19 00:26:48 devstack sudo[115177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:48 devstack sudo[115177]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c" returned: 0 in 0.268s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.565s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1938984352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8e459b-37d4-4339-9f25-c7a10d179c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:47Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating volume 6c8e459b-37d4-4339-9f25-c7a10d179c62 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:48 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cc33ad-a076-4c76-b345-409522f0547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c15c832-647a-43c3-9523-f3c1ca32921c', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:48 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 1073741824 Aug 19 00:26:48 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765040c0-c4be-4bdc-a6e7-6798f4186475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:48 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume volume-1c15c832-647a-43c3-9523-f3c1ca32921c (1c15c832-647a-43c3-9523-f3c1ca32921c): created successfully Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (765040c0-c4be-4bdc-a6e7-6798f4186475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:48 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (324d3185-cb63-4b4a-baa7-778707253d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a567ab57-3b30-495c-8fb5-5ddccee89755 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created volume successfully. Aug 19 00:26:49 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 1073741824" returned: 0 in 0.566s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Acquiring lock "cinder-3e781b88-fc79-4635-9fb2-71667a528953-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Lock "cinder-3e781b88-fc79-4635-9fb2-71667a528953-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:49 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 Aug 19 00:26:49 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Acquiring lock "cinder-quobyte-3e781b88-fc79-4635-9fb2-71667a528953" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Lock "cinder-quobyte-3e781b88-fc79-4635-9fb2-71667a528953" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4ca82b-c050-42cd-ba5a-fe2588e72d3e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:49 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62" returned: 0 in 0.342s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-726377913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5a1886-a5a1-40a5-a376-f15482094c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a21b2caf84a414484979448bf72a604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:48Z,use_quota=True,user_id='d1b6506153264dd591158b62d55c162a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Creating volume 5c5a1886-a5a1-40a5-a376-f15482094c79 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:49 devstack sudo[115188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 Aug 19 00:26:49 devstack sudo[115188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:49 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:49 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 1073741824 Aug 19 00:26:49 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7c04c6-42e2-4d6f-a42d-2e62aa5d2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8e459b-37d4-4339-9f25-c7a10d179c62', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66864db4-376a-4690-bc48-5237ebd225cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 (6c8e459b-37d4-4339-9f25-c7a10d179c62): created successfully Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66864db4-376a-4690-bc48-5237ebd225cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (e92fe50e-aa91-4eca-8155-c874fbf6032f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Flow 'volume_create_manager' (7b3f3fff-2328-4641-932e-e41b03a12dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2aff38-102b-4a9a-ac0d-242e778bdda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-084c1a32-7c86-4141-ae28-8b0e2c844a5c tempest-CreateVolumesFromSnapshotTest-543995605 None] Created volume successfully. Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2aff38-102b-4a9a-ac0d-242e778bdda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831970854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ed6b83-480a-453a-ac51-9af6abe3798a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137ba64d8557426fbc774941dd1272f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:50Z,use_quota=True,user_id='0862a7be075a4e54896f0d0479c0c150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eeeffc1-5b40-40f0-80fc-df484373bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eeeffc1-5b40-40f0-80fc-df484373bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8aa3c5-392f-49d0-a78a-c093637888d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8aa3c5-392f-49d0-a78a-c093637888d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ed6b83-480a-453a-ac51-9af6abe3798a', 'volume_name': 'volume-08ed6b83-480a-453a-ac51-9af6abe3798a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4a19ea-97a8-4b83-a07c-cda1ad7eb91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4a19ea-97a8-4b83-a07c-cda1ad7eb91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e857b0-f43c-4a52-a540-aac61de17a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:49 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Volume 08ed6b83-480a-453a-ac51-9af6abe3798a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ed6b83-480a-453a-ac51-9af6abe3798a', 'volume_size': 1} Aug 19 00:26:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:50 devstack sudo[115188]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953" returned: 0 in 0.575s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:50 devstack sudo[115199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953 Aug 19 00:26:50 devstack sudo[115199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:50 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 1073741824" returned: 0 in 0.542s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:50 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 Aug 19 00:26:50 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:50 devstack sudo[115199]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3e781b88-fc79-4635-9fb2-71667a528953" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Lock "cinder-quobyte-3e781b88-fc79-4635-9fb2-71667a528953" released by "delete_volume" :: held 0.922s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Created reservations ['0812f4ec-9e75-4ee2-9b78-a071356b5fd0', '65f29923-1024-4377-901a-77acb0b34142', 'f3c62fb1-836d-4c77-bce7-352010f839be', 'd040b94a-4a76-42e0-bb6d-9f352739359c'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:50 devstack sudo[115205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:50 devstack sudo[115205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:50 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831970854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ed6b83-480a-453a-ac51-9af6abe3798a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137ba64d8557426fbc774941dd1272f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:50Z,use_quota=True,user_id='0862a7be075a4e54896f0d0479c0c150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Creating volume 08ed6b83-480a-453a-ac51-9af6abe3798a {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:50 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (102c4665-cd0f-4d9f-804a-bc17daf4c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5a1886-a5a1-40a5-a376-f15482094c79', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:50 devstack sudo[115208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a 1073741824 Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08af400-6044-462e-91a7-d91f5c22161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:50 devstack sudo[115208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Volume volume-5c5a1886-a5a1-40a5-a376-f15482094c79 (5c5a1886-a5a1-40a5-a376-f15482094c79): created successfully Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08af400-6044-462e-91a7-d91f5c22161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Flow 'volume_create_manager' (831cdcf1-09ce-411d-90ba-79ddecb0a5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b4156d9e-106f-48d2-aa23-9e963fcd462d tempest-CreateVolumesFromSnapshotTest-543995605 None] Created volume successfully. Aug 19 00:26:50 devstack sudo[115205]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.285s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Deleted volume successfully. Aug 19 00:26:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ecba7915-1e55-4708-8802-0639562ee3b2 tempest-VolumeImageDependencyTests-1719698387 None] Lock "cinder-3e781b88-fc79-4635-9fb2-71667a528953-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:51 devstack sudo[115208]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a 1073741824" returned: 0 in 0.502s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:51 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a Aug 19 00:26:51 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-5c5a1886-a5a1-40a5-a376-f15482094c79-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-5c5a1886-a5a1-40a5-a376-f15482094c79-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-5c5a1886-a5a1-40a5-a376-f15482094c79" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-5c5a1886-a5a1-40a5-a376-f15482094c79" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (d0f4cbf4-5479-4804-95d3-4b4b172854bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c90033-28dc-4dc0-8977-635377ac9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c6ccc-66fa-4191-8659-10b08f9ce3d2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:51 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a" returned: 0 in 0.412s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c90033-28dc-4dc0-8977-635377ac9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642201233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532933fa-f046-4ca7-a850-6dc8441d8a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:51Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7303eeeb-7609-475e-9a1a-434644c9ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7303eeeb-7609-475e-9a1a-434644c9ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f568a4-e130-4408-bac0-509e14732b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f568a4-e130-4408-bac0-509e14732b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532933fa-f046-4ca7-a850-6dc8441d8a2f', 'volume_name': 'volume-532933fa-f046-4ca7-a850-6dc8441d8a2f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c0f505-243c-498c-a8bf-a37ba89ea049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c0f505-243c-498c-a8bf-a37ba89ea049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffabf31-a008-4956-a9c6-455da8f88c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:51 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Volume 532933fa-f046-4ca7-a850-6dc8441d8a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532933fa-f046-4ca7-a850-6dc8441d8a2f', 'volume_size': 1} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642201233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532933fa-f046-4ca7-a850-6dc8441d8a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:51Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Creating volume 532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:51 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e857b0-f43c-4a52-a540-aac61de17a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ed6b83-480a-453a-ac51-9af6abe3798a', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de20b8c8-e8d7-40b7-84cb-0bd978b2ce58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:51 devstack sudo[115219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f 1073741824 Aug 19 00:26:51 devstack sudo[115218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 Aug 19 00:26:51 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:51 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Volume volume-08ed6b83-480a-453a-ac51-9af6abe3798a (08ed6b83-480a-453a-ac51-9af6abe3798a): created successfully Aug 19 00:26:51 devstack sudo[115219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de20b8c8-e8d7-40b7-84cb-0bd978b2ce58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Flow 'volume_create_manager' (7b3f3fff-2328-4641-932e-e41b03a12dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-52fb73f2-a90c-4510-8ca9-5b16377ebeae tempest-ProjectReaderTests-1995156058 None] Created volume successfully. Aug 19 00:26:51 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79" returned: 0 in 0.475s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:52 devstack sudo[115229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79 Aug 19 00:26:52 devstack sudo[115229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Acquiring lock "cinder-08ed6b83-480a-453a-ac51-9af6abe3798a-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-08ed6b83-480a-453a-ac51-9af6abe3798a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Acquiring lock "cinder-quobyte-08ed6b83-480a-453a-ac51-9af6abe3798a" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-quobyte-08ed6b83-480a-453a-ac51-9af6abe3798a" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f6d29-1568-411e-9ca1-a5de2e3bb364]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:52 devstack sudo[115229]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-5c5a1886-a5a1-40a5-a376-f15482094c79" returned: 0 in 0.348s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-5c5a1886-a5a1-40a5-a376-f15482094c79" released by "delete_volume" :: held 0.934s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:52 devstack sudo[115219]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f 1073741824" returned: 0 in 0.778s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['041650d1-60ea-44d9-903c-8d88653bfa2e', '34f61710-1f90-400f-b9c8-bed7733c3e92', '75cc8bfb-3150-4360-a2ee-ec5048368e3d', 'd30c76a7-decb-4c22-93e8-be8b88b10102'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:52 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a Aug 19 00:26:52 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:52 devstack sudo[115234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f Aug 19 00:26:52 devstack sudo[115234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:52 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:52 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:52 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a" returned: 0 in 0.447s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:52 devstack sudo[115243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a Aug 19 00:26:52 devstack sudo[115243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:52 devstack sudo[115234]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f" returned: 0 in 0.337s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffabf31-a008-4956-a9c6-455da8f88c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532933fa-f046-4ca7-a850-6dc8441d8a2f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13e8a84-0918-4c4d-8fe4-8337cacc7967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:52 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Volume volume-532933fa-f046-4ca7-a850-6dc8441d8a2f (532933fa-f046-4ca7-a850-6dc8441d8a2f): created successfully Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13e8a84-0918-4c4d-8fe4-8337cacc7967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (d0f4cbf4-5479-4804-95d3-4b4b172854bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b2bceb69-0077-4c6a-91df-4cc7d0f71ade tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:26:52 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleted volume successfully. Aug 19 00:26:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40fedbba-c157-4ed6-aa1c-97133d769a09 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-5c5a1886-a5a1-40a5-a376-f15482094c79-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:53 devstack sudo[115243]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-08ed6b83-480a-453a-ac51-9af6abe3798a" returned: 0 in 0.307s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-quobyte-08ed6b83-480a-453a-ac51-9af6abe3798a" released by "delete_volume" :: held 0.810s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Created reservations ['eeba14d6-a9fe-4a69-a216-0953b0086bb1', '1162c99e-ab85-46ef-8888-78b168f66450', '16799a74-61ad-4f49-8fa4-796c212743de', '8d2965e8-f4fa-4e58-bf2f-5574356a18b2'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:53 devstack sudo[115247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:53 devstack sudo[115247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:53 devstack sudo[115247]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.264s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Deleted volume successfully. Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-84267ffe-3a13-4b36-8e8f-140079ca1178 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-08ed6b83-480a-453a-ac51-9af6abe3798a-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-6c8e459b-37d4-4339-9f25-c7a10d179c62-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-6c8e459b-37d4-4339-9f25-c7a10d179c62-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-6c8e459b-37d4-4339-9f25-c7a10d179c62" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-6c8e459b-37d4-4339-9f25-c7a10d179c62" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28c181-036b-4848-bfa0-e6cc6872de82]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Flow 'volume_create_manager' (25d8f46c-c0bd-4bf3-a3fc-1d5a56ee873e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:53 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18f4854-bf26-4737-9e75-4b01d2f44dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18f4854-bf26-4737-9e75-4b01d2f44dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295356714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137ba64d8557426fbc774941dd1272f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:54Z,use_quota=True,user_id='0862a7be075a4e54896f0d0479c0c150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91815fa8-1bc0-47e5-9aec-27c548e30aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91815fa8-1bc0-47e5-9aec-27c548e30aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b4e63b-1698-4ca5-bb9c-816237e5b05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:54 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 Aug 19 00:26:54 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b4e63b-1698-4ca5-bb9c-816237e5b05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23', 'volume_name': 'volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73e0196-f8f8-42c1-bd86-58b7745a7b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d73e0196-f8f8-42c1-bd86-58b7745a7b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd2b32-0265-4fe3-b00b-7e2da54ec2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:54 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Volume bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23', 'volume_size': 1} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295356714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137ba64d8557426fbc774941dd1272f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:26:54Z,use_quota=True,user_id='0862a7be075a4e54896f0d0479c0c150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Creating volume bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:26:54 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:54 devstack sudo[115252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 1073741824 Aug 19 00:26:54 devstack sudo[115252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:54 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62" returned: 0 in 0.465s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:54 devstack sudo[115260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62 Aug 19 00:26:54 devstack sudo[115260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:54 devstack sudo[115252]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 1073741824" returned: 0 in 0.485s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:54 devstack sudo[115260]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-6c8e459b-37d4-4339-9f25-c7a10d179c62" returned: 0 in 0.265s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-6c8e459b-37d4-4339-9f25-c7a10d179c62" released by "delete_volume" :: held 0.786s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:54 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 Aug 19 00:26:54 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['160792b5-7fff-421f-a053-f94300cbef97', 'fe0a621d-5985-406e-af7e-1fb1876b2ca3', 'f66be52d-11a4-43ab-a20c-c00c8479effc', '11ca8fc6-e79a-4ebe-8109-550a92fdfe76'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:54 devstack sudo[115267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:54 devstack sudo[115267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:54 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23" returned: 0 in 0.284s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.784s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd2b32-0265-4fe3-b00b-7e2da54ec2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad64e6-4de0-430a-92c8-379b34d5ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:26:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Creating offline snapshot 5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 of volume 532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:26:55 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Volume volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 (bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23): created successfully Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad64e6-4de0-430a-92c8-379b34d5ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Flow 'volume_create_manager' (25d8f46c-c0bd-4bf3-a3fc-1d5a56ee873e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-1c15c832-647a-43c3-9523-f3c1ca32921c-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcfcd9-0d50-4e46-98ef-70ee47152140]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a8222126-ebbb-4ab6-b19f-8108d9d2bd0d tempest-ProjectReaderTests-1995156058 None] Created volume successfully. Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-1c15c832-647a-43c3-9523-f3c1ca32921c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-1c15c832-647a-43c3-9523-f3c1ca32921c" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:55 devstack sudo[115267]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.345s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleted volume successfully. Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-1c15c832-647a-43c3-9523-f3c1ca32921c" acquired by "delete_volume" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:55 devstack sudo[115270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f Aug 19 00:26:55 devstack sudo[115270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e7d99-7557-418a-ba38-2138afff5857]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0a254f9e-16ef-4c84-80b0-cc1aa084c438 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-6c8e459b-37d4-4339-9f25-c7a10d179c62-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:55 devstack sudo[115273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c Aug 19 00:26:55 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:55 devstack sudo[115270]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f" returned: 0 in 0.423s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:55 devstack sudo[115278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 1G Aug 19 00:26:55 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:55 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c" returned: 0 in 0.394s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-71e0fb1b-fd25-4c4b-aada-b49bf0e8d014 tempest-ProjectAdminTests-181934496 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6953582763672, 'free_capacity_gb': 1775.6953582763672, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94243) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 19 00:26:55 devstack sudo[115283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c Aug 19 00:26:55 devstack sudo[115283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:55 devstack sudo[115283]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-1c15c832-647a-43c3-9523-f3c1ca32921c" returned: 0 in 0.283s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:55 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 1G" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532933fa-f046-4ca7-a850-6dc8441d8a2f -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-1c15c832-647a-43c3-9523-f3c1ca32921c" released by "delete_volume" :: held 0.735s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:55 devstack sudo[115289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532933fa-f046-4ca7-a850-6dc8441d8a2f -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 Aug 19 00:26:55 devstack sudo[115289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:55 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['baf285d4-fb0a-4736-acc1-70f50540adfd', '9910056a-0e1e-4568-9f44-571d7f395710', '2de85790-fe39-468f-9e87-e93d8ebc8ab4', 'fabd8e2e-b933-4df8-a20c-a501c723e420'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:56 devstack sudo[115291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:56 devstack sudo[115291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Acquiring lock "cinder-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Acquiring lock "cinder-quobyte-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-quobyte-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a9283b-bcda-43c4-88b9-f78d090683ea]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:56 devstack sudo[115289]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532933fa-f046-4ca7-a850-6dc8441d8a2f -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" returned: 0 in 0.435s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:56 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 is being set with open permissions: ugo+rw Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-47f996c5-a9e5-42a0-9e64-cd44cfd413f4-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:56 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 Aug 19 00:26:56 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-47f996c5-a9e5-42a0-9e64-cd44cfd413f4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:56 devstack sudo[115291]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.428s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-47f996c5-a9e5-42a0-9e64-cd44cfd413f4" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:56 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleted volume successfully. Aug 19 00:26:56 devstack sudo[115296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 Aug 19 00:26:56 devstack sudo[115296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-47f996c5-a9e5-42a0-9e64-cd44cfd413f4" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a216b5c4-e141-45be-a2ff-ccbecc0faeba tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-1c15c832-647a-43c3-9523-f3c1ca32921c-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[099c1dd1-c1a0-45db-a26d-6917b36fa559]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:56 devstack sudo[115301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 Aug 19 00:26:56 devstack sudo[115301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:56 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:56 devstack sudo[115306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info Aug 19 00:26:56 devstack sudo[115306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:56 devstack sudo[115296]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23" returned: 0 in 0.526s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:56 devstack sudo[115309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23 Aug 19 00:26:56 devstack sudo[115309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:56 devstack sudo[115301]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4" returned: 0 in 0.439s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:57 devstack sudo[115316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4 Aug 19 00:26:57 devstack sudo[115316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:57 devstack sudo[115306]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info" returned: 0 in 0.297s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:57 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info is being set with open permissions: ugo+rw Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:57 devstack sudo[115318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info Aug 19 00:26:57 devstack sudo[115318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:57 devstack sudo[115309]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23" returned: 0 in 0.349s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-quobyte-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23" released by "delete_volume" :: held 0.933s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Created reservations ['37525934-a157-45c9-b71a-2af4ff71b8a5', '7931bf8c-202a-4ca5-9ef8-10bd2c94a014', '034a2b2f-a002-4b99-a4f0-2a45a2063598', '8deb25bb-fc98-4465-b4b0-1789e98a4302'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:57 devstack sudo[115316]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-47f996c5-a9e5-42a0-9e64-cd44cfd413f4" returned: 0 in 0.351s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-47f996c5-a9e5-42a0-9e64-cd44cfd413f4" released by "delete_volume" :: held 0.845s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:57 devstack sudo[115318]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.info" returned: 0 in 0.378s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['a805d4d0-1ed0-4689-b416-50aab1334456', '513fc259-4daa-4277-9905-2f0bacbabf6f', '4a96e471-2bfe-4813-8895-c4a922e1e2cd', '50f2e8cc-e406-47c6-849d-a74709c5efe1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:57 devstack sudo[115323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:57 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ccac8963-6d07-4167-8b61-ac0f4f1f112d tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:57 devstack sudo[115325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:57 devstack sudo[115325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:57 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.295s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Deleted volume successfully. Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4222e415-c043-479b-88ec-da11d8dad9c9 tempest-ProjectReaderTests-1995156058 None] Lock "cinder-bfb8ecf1-b81d-44f2-9d35-4e34bdb7db23-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:57 devstack sudo[115325]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.284s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:26:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleted volume successfully. Aug 19 00:26:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-860edc62-cda0-47e8-b0d4-af597c8b81c6 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-47f996c5-a9e5-42a0-9e64-cd44cfd413f4-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Lock "cinder-5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-532933fa-f046-4ca7-a850-6dc8441d8a2f" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-532933fa-f046-4ca7-a850-6dc8441d8a2f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot 5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 of volume 532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[29255ffe-2dc8-4f93-8b1b-08e8ae77a72f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:58 devstack sudo[115329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 Aug 19 00:26:58 devstack sudo[115329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-e64e966b-7419-48b9-9ba9-4ecb122224cc-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-e64e966b-7419-48b9-9ba9-4ecb122224cc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-e64e966b-7419-48b9-9ba9-4ecb122224cc" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-e64e966b-7419-48b9-9ba9-4ecb122224cc" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b376de1d-a275-4654-aef1-34a723c11de1]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:58 devstack sudo[115329]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" returned: 0 in 0.419s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532933fa-f046-4ca7-a850-6dc8441d8a2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68075bb-b8e0-437d-95b2-5d3de8c0991c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:26:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:58 devstack sudo[115338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc Aug 19 00:26:58 devstack sudo[115338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:59 devstack sudo[115339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f Aug 19 00:26:59 devstack sudo[115339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:59 devstack sudo[115338]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc" returned: 0 in 0.452s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:59 devstack sudo[115345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc Aug 19 00:26:59 devstack sudo[115345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:59 devstack sudo[115339]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f" returned: 0 in 0.562s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:59 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 Aug 19 00:26:59 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:59 devstack sudo[115345]: pam_unix(sudo:session): session closed for user root Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e64e966b-7419-48b9-9ba9-4ecb122224cc" returned: 0 in 0.358s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-e64e966b-7419-48b9-9ba9-4ecb122224cc" released by "delete_volume" :: held 0.877s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['7a1c7be7-c6d5-4703-b4ee-da7ad8c2bf2f', '30adbaad-0016-44dc-aed1-e0c4be675d50', '832ec49d-5bad-4934-b931-059e712603ee', '8b08b042-c21f-4b63-9d96-84307089c5b4'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:26:59 devstack sudo[115356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:26:59 devstack sudo[115356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-ce73546a-f6ac-4dfd-b7b8-3292741b3ba1-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-ce73546a-f6ac-4dfd-b7b8-3292741b3ba1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-86a92a81-a7ca-43b7-af93-b7268b0f5149" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-86a92a81-a7ca-43b7-af93-b7268b0f5149" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:26:59 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:26:59 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" returned: 0 in 0.550s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleting offline snapshot ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 of volume 86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:00 devstack sudo[115358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536 Aug 19 00:27:00 devstack sudo[115358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] snapshot_file for this snap is: volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e0919-59ea-4264-9785-ce5148c95a15]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:00 devstack sudo[115360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 Aug 19 00:27:00 devstack sudo[115360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:00 devstack sudo[115356]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.409s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleted volume successfully. Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4784ed56-b3cc-4860-aa58-9f23a8554003 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-e64e966b-7419-48b9-9ba9-4ecb122224cc-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:00 devstack sudo[115358]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f.5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" returned: 0 in 0.401s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536" released by "_delete_snapshot" :: held 2.084s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-532933fa-f046-4ca7-a850-6dc8441d8a2f" released by "delete_snapshot" :: held 2.118s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:00 devstack sudo[115360]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" returned: 0 in 0.494s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86a92a81-a7ca-43b7-af93-b7268b0f5149(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e6400-0101-4219-8a1e-b615c7f8c7b8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Created reservations ['747ad499-574a-44f1-a493-ca48101756fc', '49e38da5-dd6a-4c42-a19b-da9ba16f06c5', '69c9fa65-e55b-4540-9ac2-503fa6eb9326', 'e4871633-9f28-4c7a-a5b9-6e5bee08887d'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-87b6a290-fbf4-46a9-84d7-cb30ed305cc8 tempest-ProjectMemberTests-237211261 None] Lock "cinder-5a812ce6-a8cf-4fb0-a6f7-48b5b2a4b536-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:00 devstack sudo[115368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 Aug 19 00:27:00 devstack sudo[115368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:00 devstack sudo[115368]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149" returned: 0 in 0.381s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:01 devstack sudo[115373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 Aug 19 00:27:01 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:01 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" returned: 0 in 0.409s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:01 devstack sudo[115378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1 Aug 19 00:27:01 devstack sudo[115378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-532933fa-f046-4ca7-a850-6dc8441d8a2f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Lock "cinder-532933fa-f046-4ca7-a850-6dc8441d8a2f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=287,cinder:SELECT=230,cinder:DELETE=33,cinder:INSERT=79 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-532933fa-f046-4ca7-a850-6dc8441d8a2f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:01 devstack sudo[115378]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-532933fa-f046-4ca7-a850-6dc8441d8a2f" acquired by "delete_volume" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149.ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" returned: 0 in 0.348s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=205,cinder:UPDATE=306,cinder:INSERT=78,cinder:DELETE=21 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[24556930-899e-4888-b478-5fb7107b38fa]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-ce73546a-f6ac-4dfd-b7b8-3292741b3ba1" released by "_delete_snapshot" :: held 1.802s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-86a92a81-a7ca-43b7-af93-b7268b0f5149" released by "delete_snapshot" :: held 1.848s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:01 devstack sudo[115381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f Aug 19 00:27:01 devstack sudo[115381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['31893688-35ec-49a4-abdf-f74dff506928', '7af5b9ff-88b6-4c64-a1fe-a8ce8f232000', '1008405c-48a5-4b3c-90dd-0488e9baa144', '758e4bef-0a6e-4580-ac20-57f69c41e1aa'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:01 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Delete snapshot completed successfully. Aug 19 00:27:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-f8b54fa7-db03-45f0-8b79-9e66ea20db56 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-ce73546a-f6ac-4dfd-b7b8-3292741b3ba1-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-86a92a81-a7ca-43b7-af93-b7268b0f5149-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-86a92a81-a7ca-43b7-af93-b7268b0f5149-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:02 devstack sudo[115381]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f" returned: 0 in 0.461s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "cinder-quobyte-86a92a81-a7ca-43b7-af93-b7268b0f5149" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:02 devstack sudo[115388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f Aug 19 00:27:02 devstack sudo[115388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-86a92a81-a7ca-43b7-af93-b7268b0f5149" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[368ba4e4-c579-4e8d-adaa-2987eef31c86]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:02 devstack sudo[115390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 Aug 19 00:27:02 devstack sudo[115390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:02 devstack sudo[115388]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-532933fa-f046-4ca7-a850-6dc8441d8a2f" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-532933fa-f046-4ca7-a850-6dc8441d8a2f" released by "delete_volume" :: held 0.862s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Created reservations ['aa32fa42-9c57-4189-a137-cde56724df6d', '73883759-af5a-4e3b-a274-cf173d27f0d1', 'e340fc22-b910-4471-8e00-664f76a09e1d', 'd330973b-13ed-4e8f-80d6-2f27fd3546f7'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:02 devstack sudo[115396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:02 devstack sudo[115396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:02 devstack sudo[115390]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149" returned: 0 in 0.517s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:02 devstack sudo[115398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149 Aug 19 00:27:02 devstack sudo[115398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:03 devstack sudo[115396]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.327s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:03 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9d2ab97f-d32b-4a26-94a5-909e9ca0d338 tempest-ProjectMemberTests-237211261 None] Lock "cinder-532933fa-f046-4ca7-a850-6dc8441d8a2f-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:03 devstack sudo[115398]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-86a92a81-a7ca-43b7-af93-b7268b0f5149" returned: 0 in 0.449s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-quobyte-86a92a81-a7ca-43b7-af93-b7268b0f5149" released by "delete_volume" :: held 1.037s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Created reservations ['63a1bd9c-f84e-418c-bc39-f96279b67e3f', '9b83a2f8-eb35-4943-8382-827bd0a765e6', '248789c2-fa30-4231-bc4c-cd52f989418e', '4e1b798f-ce7d-4aea-ad55-ed66fd7653d9'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (a34f1a36-009b-43bf-920e-39246067673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dadbbc8-cbd1-483f-b9a0-bc8c23ca6720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:03 devstack sudo[115402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dadbbc8-cbd1-483f-b9a0-bc8c23ca6720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1405669581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d446b33-648e-4e5c-aee5-c0babdb694da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:03Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:03 devstack sudo[115402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bf6b32-5c68-4cc3-b00a-2c968375db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bf6b32-5c68-4cc3-b00a-2c968375db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57dc4654-184d-4d83-8d7d-72a06c39f0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57dc4654-184d-4d83-8d7d-72a06c39f0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d446b33-648e-4e5c-aee5-c0babdb694da', 'volume_name': 'volume-2d446b33-648e-4e5c-aee5-c0babdb694da', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6dab99-c519-4b6b-8ac1-c827abd18312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6dab99-c519-4b6b-8ac1-c827abd18312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b9dc81-7762-40b5-903b-e2f5f2176abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:03 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Volume 2d446b33-648e-4e5c-aee5-c0babdb694da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d446b33-648e-4e5c-aee5-c0babdb694da', 'volume_size': 1} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1405669581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d446b33-648e-4e5c-aee5-c0babdb694da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:03Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Creating volume 2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:03 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:03 devstack sudo[115404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da 1073741824 Aug 19 00:27:03 devstack sudo[115404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:03 devstack sudo[115402]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.334s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:03 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Deleted volume successfully. Aug 19 00:27:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-7397ffff-235a-4aa2-b034-ad934c11aab5 tempest-CreateVolumesFromSnapshotTest-543995605 None] Lock "cinder-86a92a81-a7ca-43b7-af93-b7268b0f5149-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:04 devstack sudo[115404]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da 1073741824" returned: 0 in 0.535s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:04 devstack sudo[115411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da Aug 19 00:27:04 devstack sudo[115411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:04 devstack sudo[115411]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da" returned: 0 in 0.331s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b9dc81-7762-40b5-903b-e2f5f2176abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d446b33-648e-4e5c-aee5-c0babdb694da', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594c6fd1-5fb3-42e1-a7a3-abba7b118ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:04 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Volume volume-2d446b33-648e-4e5c-aee5-c0babdb694da (2d446b33-648e-4e5c-aee5-c0babdb694da): created successfully Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594c6fd1-5fb3-42e1-a7a3-abba7b118ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (a34f1a36-009b-43bf-920e-39246067673d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-73c9885b-a743-4481-92ed-1777ce8052ef tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Creating offline snapshot 7d98ab1d-da45-4805-b37a-12ae0a576a8d of volume 2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:05 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a8b1b5-b90e-4d71-b9b8-764c7b83ee7f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:06 devstack sudo[115414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da Aug 19 00:27:06 devstack sudo[115414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:06 devstack sudo[115414]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da" returned: 0 in 0.512s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:06 devstack sudo[115419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d 1G Aug 19 00:27:06 devstack sudo[115419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:06 devstack sudo[115419]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d 1G" returned: 0 in 0.550s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d446b33-648e-4e5c-aee5-c0babdb694da -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:07 devstack sudo[115425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d446b33-648e-4e5c-aee5-c0babdb694da -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d Aug 19 00:27:07 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:07 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d446b33-648e-4e5c-aee5-c0babdb694da -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:07 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d is being set with open permissions: ugo+rw Aug 19 00:27:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:07 devstack sudo[115431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d Aug 19 00:27:07 devstack sudo[115431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:07 devstack sudo[115431]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d" returned: 0 in 0.290s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:07 devstack sudo[115434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info Aug 19 00:27:07 devstack sudo[115434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:07 devstack sudo[115434]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:08 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info is being set with open permissions: ugo+rw Aug 19 00:27:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:08 devstack sudo[115437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info Aug 19 00:27:08 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:08 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.info" returned: 0 in 0.272s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:08 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-48a92427-fb70-4942-9407-63d94a9cac7f tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (5395ae4a-ec62-4c84-b8d2-6b91dd9f7fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c50e988-c185-4dc3-89bf-dbba2d144c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-7d98ab1d-da45-4805-b37a-12ae0a576a8d-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c50e988-c185-4dc3-89bf-dbba2d144c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084797669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655aeee8-0c4f-40ef-b03d-bdb4fcae11b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:09Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834b800f-6649-4b69-9802-83d4ef663166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834b800f-6649-4b69-9802-83d4ef663166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee88074c-7795-4233-95ff-f386bf2e1bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee88074c-7795-4233-95ff-f386bf2e1bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655aeee8-0c4f-40ef-b03d-bdb4fcae11b4', 'volume_name': 'volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c86895-f02f-4f53-abc8-f961b5f2c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c86895-f02f-4f53-abc8-f961b5f2c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f8ae1d-c88c-4d47-a84b-f96d7ce1059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:09 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Volume 655aeee8-0c4f-40ef-b03d-bdb4fcae11b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4', 'volume_size': 1} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084797669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655aeee8-0c4f-40ef-b03d-bdb4fcae11b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:09Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Creating volume 655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:09 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Lock "cinder-7d98ab1d-da45-4805-b37a-12ae0a576a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.109s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-2d446b33-648e-4e5c-aee5-c0babdb694da" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:09 devstack sudo[115440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 1073741824 Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-2d446b33-648e-4e5c-aee5-c0babdb694da" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-7d98ab1d-da45-4805-b37a-12ae0a576a8d" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:09 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-7d98ab1d-da45-4805-b37a-12ae0a576a8d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot 7d98ab1d-da45-4805-b37a-12ae0a576a8d of volume 2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1db0b-b8ca-40c3-9c47-946b6b16cb93]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:09 devstack sudo[115442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d Aug 19 00:27:09 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:09 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d" returned: 0 in 0.533s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d446b33-648e-4e5c-aee5-c0babdb694da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[801bf582-452c-444c-957a-cd7609d8f6a8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:09 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 1073741824" returned: 0 in 0.727s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:10 devstack sudo[115453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 Aug 19 00:27:10 devstack sudo[115453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:10 devstack sudo[115452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da Aug 19 00:27:10 devstack sudo[115452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:10 devstack sudo[115453]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" returned: 0 in 0.281s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f8ae1d-c88c-4d47-a84b-f96d7ce1059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d7fbbb-b280-4193-b966-05cbda1e151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:10 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Volume volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 (655aeee8-0c4f-40ef-b03d-bdb4fcae11b4): created successfully Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d7fbbb-b280-4193-b966-05cbda1e151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (5395ae4a-ec62-4c84-b8d2-6b91dd9f7fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:10 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7ddb1e32-3eca-48a2-addf-b04e9284004a tempest-ProjectReaderTests-1289080493 None] Created volume successfully. Aug 19 00:27:10 devstack sudo[115452]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da" returned: 0 in 0.472s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:10 devstack sudo[115461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d Aug 19 00:27:10 devstack sudo[115461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:10 devstack sudo[115461]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d" returned: 0 in 0.367s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:10 devstack sudo[115467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d Aug 19 00:27:10 devstack sudo[115467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:11 devstack sudo[115467]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da.7d98ab1d-da45-4805-b37a-12ae0a576a8d" returned: 0 in 0.324s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-7d98ab1d-da45-4805-b37a-12ae0a576a8d" released by "_delete_snapshot" :: held 1.858s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-2d446b33-648e-4e5c-aee5-c0babdb694da" released by "delete_snapshot" :: held 1.897s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Created reservations ['744b761e-a783-438a-bfd8-d8b39e2d679d', '91e9052c-986e-4bf5-b135-35deab7f7f5e', 'e9ea6f3e-100e-430d-8871-e2a9f56e182a', '3c1a6f4f-9f17-4da6-bd52-07006715682a'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-0c6520d6-0c8d-4cf9-a58f-85fa0710f35e tempest-ProjectMemberTests-237211261 None] Lock "cinder-7d98ab1d-da45-4805-b37a-12ae0a576a8d-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Creating offline snapshot 8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 of volume 655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[07735ed8-1e85-472e-9a64-8ef211a2f3cb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:11 devstack sudo[115472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 Aug 19 00:27:11 devstack sudo[115472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:12 devstack sudo[115472]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" returned: 0 in 0.443s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:12 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 1G Aug 19 00:27:12 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-2d446b33-648e-4e5c-aee5-c0babdb694da-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Lock "cinder-2d446b33-648e-4e5c-aee5-c0babdb694da-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-2d446b33-648e-4e5c-aee5-c0babdb694da" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:12 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-2d446b33-648e-4e5c-aee5-c0babdb694da" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 1G" returned: 0 in 0.550s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c4fa7-5946-43d5-af19-6a584fcc5a79]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:12 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:12 devstack sudo[115484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 Aug 19 00:27:12 devstack sudo[115484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:12 devstack sudo[115485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da Aug 19 00:27:12 devstack sudo[115485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack sudo[115484]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" returned: 0 in 0.382s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 is being set with open permissions: ugo+rw Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:13 devstack sudo[115485]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da" returned: 0 in 0.407s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack sudo[115494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 Aug 19 00:27:13 devstack sudo[115494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:13 devstack sudo[115496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da Aug 19 00:27:13 devstack sudo[115496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack sudo[115494]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:13 devstack sudo[115500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info Aug 19 00:27:13 devstack sudo[115500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack sudo[115496]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-2d446b33-648e-4e5c-aee5-c0babdb694da" returned: 0 in 0.338s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack sudo[115502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:13 devstack sudo[115502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-2d446b33-648e-4e5c-aee5-c0babdb694da" released by "delete_volume" :: held 0.822s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Created reservations ['c95d78b7-9452-4945-8519-8e1c0ab72b2a', '84b08a70-3852-4b16-aab1-73ed479a09af', '7c39e0f7-93a9-41a3-af0d-eea251758160', '2894945b-9186-4914-abd9-a91b95f78338'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:13 devstack sudo[115504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:13 devstack sudo[115504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack sudo[115502]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.442s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:13 devstack sudo[115500]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info" returned: 0 in 0.492s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info is being set with open permissions: ugo+rw Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:27:13 devstack sudo[115508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info Aug 19 00:27:13 devstack sudo[115508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:13 devstack sudo[115504]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.320s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:13 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:13 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-8f2d90f5-4b2c-45e1-bd59-ec4024688f91 tempest-ProjectMemberTests-237211261 None] Lock "cinder-2d446b33-648e-4e5c-aee5-c0babdb694da-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:14 devstack sudo[115508]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.info" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:14 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5d2c0538-eaec-4f80-8815-20aa6b8c386d tempest-ProjectReaderTests-1289080493 None] Create snapshot completed successfully Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (77ac2f0f-94a5-4e48-bd9c-5854f2775c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abc0c09-2954-4760-9048-16c3fdf7caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abc0c09-2954-4760-9048-16c3fdf7caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203572769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099808d4-5762-4ab7-b64c-3d05d26752bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:14Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b6fab5-757f-4ebc-abd6-812c4a011dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b6fab5-757f-4ebc-abd6-812c4a011dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09525f8d-84af-48a4-8ea7-39e530579e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09525f8d-84af-48a4-8ea7-39e530579e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099808d4-5762-4ab7-b64c-3d05d26752bf', 'volume_name': 'volume-099808d4-5762-4ab7-b64c-3d05d26752bf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e49b0d-c460-4667-b957-e392afcc3413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e49b0d-c460-4667-b957-e392afcc3413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6c83f1-7aa4-41e9-a58d-f5dea63a3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:14 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Volume 099808d4-5762-4ab7-b64c-3d05d26752bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099808d4-5762-4ab7-b64c-3d05d26752bf', 'volume_size': 1} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203572769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099808d4-5762-4ab7-b64c-3d05d26752bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:14Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Creating volume 099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:14 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:14 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:14 devstack sudo[115512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf 1073741824 Aug 19 00:27:14 devstack sudo[115512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-8c5a6b85-bc1b-4887-9a3e-c9eb28677d90-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-8c5a6b85-bc1b-4887-9a3e-c9eb28677d90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Deleting offline snapshot 8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 of volume 655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:15 devstack sudo[115512]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] snapshot_file for this snap is: volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf 1073741824" returned: 0 in 0.626s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5189ca00-2e06-41d4-a35b-498738bef474]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:15 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf Aug 19 00:27:15 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:15 devstack sudo[115518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 Aug 19 00:27:15 devstack sudo[115518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:15 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf" returned: 0 in 0.325s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6c83f1-7aa4-41e9-a58d-f5dea63a3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099808d4-5762-4ab7-b64c-3d05d26752bf', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e7db31-dc85-4ad9-b074-80e69aac294a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:15 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Volume volume-099808d4-5762-4ab7-b64c-3d05d26752bf (099808d4-5762-4ab7-b64c-3d05d26752bf): created successfully Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e7db31-dc85-4ad9-b074-80e69aac294a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (77ac2f0f-94a5-4e48-bd9c-5854f2775c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:15 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-dcdb24e2-860b-4f6f-9f7f-4c3e15eeaed8 tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:15 devstack sudo[115518]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" returned: 0 in 0.560s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e6af1e-2939-42ce-b364-9b43b6c955e2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:15 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:15 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 Aug 19 00:27:15 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:16 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" returned: 0 in 0.406s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:16 devstack sudo[115533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 Aug 19 00:27:16 devstack sudo[115533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:16 devstack sudo[115533]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" returned: 0 in 0.467s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:16 devstack sudo[115539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90 Aug 19 00:27:16 devstack sudo[115539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Creating offline snapshot 14cfa525-9c2b-4933-b734-3bf15176b82b of volume 099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae929aa-d6ee-48a9-9a0f-d0f3e8ded039]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:16 devstack sudo[115539]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:16 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4.8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" returned: 0 in 0.295s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:16 devstack sudo[115541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf Aug 19 00:27:16 devstack sudo[115541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-8c5a6b85-bc1b-4887-9a3e-c9eb28677d90" released by "_delete_snapshot" :: held 1.856s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" released by "delete_snapshot" :: held 1.882s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Created reservations ['c6c64f27-d57c-48ec-bdc4-1cbddedb96f9', 'fc69c9be-dafa-4332-a232-3dcaaf3d4e8d', '05be8d8b-3c8f-46c3-b101-e260a8fb6dc4', '0051d909-a907-4a7d-bf40-257b2d216ef5'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:17 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Delete snapshot completed successfully. Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-c5845e37-3f4d-4a64-802a-07e53d4aee96 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-8c5a6b85-bc1b-4887-9a3e-c9eb28677d90-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:17 devstack sudo[115541]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf" returned: 0 in 0.653s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae969cfc-220b-4201-8d9d-84b701dfb740]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:17 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:17 devstack sudo[115581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b 1G Aug 19 00:27:17 devstack sudo[115581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:17 devstack sudo[115582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 Aug 19 00:27:17 devstack sudo[115582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:18 devstack sudo[115581]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b 1G" returned: 0 in 0.583s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099808d4-5762-4ab7-b64c-3d05d26752bf -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:18 devstack sudo[115593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099808d4-5762-4ab7-b64c-3d05d26752bf -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b Aug 19 00:27:18 devstack sudo[115593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:18 devstack sudo[115582]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" returned: 0 in 0.629s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:18 devstack sudo[115595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4 Aug 19 00:27:18 devstack sudo[115595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:18 devstack sudo[115593]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-099808d4-5762-4ab7-b64c-3d05d26752bf -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b" returned: 0 in 0.359s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:18 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b is being set with open permissions: ugo+rw Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:18 devstack sudo[115595]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" returned: 0 in 0.329s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:18 devstack sudo[115602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b Aug 19 00:27:18 devstack sudo[115602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4" released by "delete_volume" :: held 1.056s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Created reservations ['2a445bd4-b652-415f-9b88-745522f44507', '598e60ca-6eb9-47a6-a7a1-73c2c50e0683', 'e9820def-2a09-474a-8652-a03a0a023a40', 'f0cb0ba2-2b71-44d1-aab7-739d508ab459'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:18 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:18 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:18 devstack sudo[115602]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b" returned: 0 in 0.371s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:18 devstack sudo[115607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info Aug 19 00:27:18 devstack sudo[115607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (8b496011-18bd-40a9-80c3-420bc349058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258ac143-3d90-4481-adfd-89e70902ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258ac143-3d90-4481-adfd-89e70902ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780180333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af457168-0625-4a51-b483-b4194f00bb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:19Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:18 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6907c385-a743-4135-8f86-1c3c9b6fd234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6907c385-a743-4135-8f86-1c3c9b6fd234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11695b45-84f6-493d-9a7e-3acb2fe96177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11695b45-84f6-493d-9a7e-3acb2fe96177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af457168-0625-4a51-b483-b4194f00bb92', 'volume_name': 'volume-af457168-0625-4a51-b483-b4194f00bb92', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3475bd74-7372-4e9c-95cf-4fc46f7d660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:18 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3475bd74-7372-4e9c-95cf-4fc46f7d660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d7227d-eed4-494f-a948-efd0a3070173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:19 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Volume af457168-0625-4a51-b483-b4194f00bb92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af457168-0625-4a51-b483-b4194f00bb92', 'volume_size': 1} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.313s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Deleted volume successfully. Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-27b3c471-3b85-4fa6-9ba6-21ed7372362f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-655aeee8-0c4f-40ef-b03d-bdb4fcae11b4-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:19 devstack sudo[115607]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:19 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info is being set with open permissions: ugo+rw Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:19 devstack sudo[115611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info Aug 19 00:27:19 devstack sudo[115611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:19 devstack sudo[115611]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.info" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1780180333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af457168-0625-4a51-b483-b4194f00bb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:19Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Creating volume af457168-0625-4a51-b483-b4194f00bb92 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:19 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:19 devstack sudo[115614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 1073741824 Aug 19 00:27:19 devstack sudo[115614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:19 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-67d9b0eb-37a2-40fa-a1c0-e53ffd1cb73c tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:27:19 devstack sudo[115614]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 1073741824" returned: 0 in 0.496s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:19 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:20 devstack sudo[115620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 Aug 19 00:27:20 devstack sudo[115620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-14cfa525-9c2b-4933-b734-3bf15176b82b-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (e52132e8-10fb-44d7-809c-05b99401ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3aa1ed-4354-4a3b-a644-8a165c08045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Lock "cinder-14cfa525-9c2b-4933-b734-3bf15176b82b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-099808d4-5762-4ab7-b64c-3d05d26752bf" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3aa1ed-4354-4a3b-a644-8a165c08045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488162009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b280aca-3e04-4968-8dbf-e7a98e338881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:20Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd410312-c87d-4367-865f-255b962f44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd410312-c87d-4367-865f-255b962f44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07262e77-17e6-4e8b-b30f-5bc2f4ce3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07262e77-17e6-4e8b-b30f-5bc2f4ce3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b280aca-3e04-4968-8dbf-e7a98e338881', 'volume_name': 'volume-3b280aca-3e04-4968-8dbf-e7a98e338881', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826fbedf-5e25-499e-9267-ac57850d76c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826fbedf-5e25-499e-9267-ac57850d76c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36d6b6f-b225-474d-b7c1-8a501a72eec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Volume 3b280aca-3e04-4968-8dbf-e7a98e338881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b280aca-3e04-4968-8dbf-e7a98e338881', 'volume_size': 1} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-099808d4-5762-4ab7-b64c-3d05d26752bf" acquired by "delete_snapshot" :: waited 0.072s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-14cfa525-9c2b-4933-b734-3bf15176b82b" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-14cfa525-9c2b-4933-b734-3bf15176b82b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot 14cfa525-9c2b-4933-b734-3bf15176b82b of volume 099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a1ef26-80f4-4797-bc26-f80ce03bb8ef]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:20 devstack sudo[115620]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92" returned: 0 in 0.301s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-488162009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b280aca-3e04-4968-8dbf-e7a98e338881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:20Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Creating volume 3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:20 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d7227d-eed4-494f-a948-efd0a3070173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af457168-0625-4a51-b483-b4194f00bb92', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40edd12a-602e-45c6-abd8-f1d5c9ef5099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:20 devstack sudo[115624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 1073741824 Aug 19 00:27:20 devstack sudo[115624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:20 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Volume volume-af457168-0625-4a51-b483-b4194f00bb92 (af457168-0625-4a51-b483-b4194f00bb92): created successfully Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40edd12a-602e-45c6-abd8-f1d5c9ef5099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:20 devstack sudo[115623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b Aug 19 00:27:20 devstack sudo[115623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (8b496011-18bd-40a9-80c3-420bc349058a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:20 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4c93e67d-a330-4cdb-a023-388a25193210 tempest-ProjectReaderTests-177271631 None] Created volume successfully. Aug 19 00:27:20 devstack sudo[115623]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-099808d4-5762-4ab7-b64c-3d05d26752bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141c4c7-72b0-4c92-8a4e-65bc91f0b127]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:20 devstack sudo[115624]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 1073741824" returned: 0 in 0.455s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:20 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf Aug 19 00:27:20 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:20 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:20 devstack sudo[115636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 Aug 19 00:27:20 devstack sudo[115636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:21 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf" returned: 0 in 0.405s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:21 devstack sudo[115642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b Aug 19 00:27:21 devstack sudo[115642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:21 devstack sudo[115636]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881" returned: 0 in 0.287s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36d6b6f-b225-474d-b7c1-8a501a72eec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b280aca-3e04-4968-8dbf-e7a98e338881', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1470dee7-8cc7-4fac-a492-6ec912747cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:21 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Volume volume-3b280aca-3e04-4968-8dbf-e7a98e338881 (3b280aca-3e04-4968-8dbf-e7a98e338881): created successfully Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1470dee7-8cc7-4fac-a492-6ec912747cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (e52132e8-10fb-44d7-809c-05b99401ae21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-26e217e4-c366-45e5-b7ac-a1921a0b3ec2 tempest-ProjectReaderTests-1289080493 None] Created volume successfully. Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-af457168-0625-4a51-b483-b4194f00bb92-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Lock "cinder-af457168-0625-4a51-b483-b4194f00bb92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-quobyte-af457168-0625-4a51-b483-b4194f00bb92" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-af457168-0625-4a51-b483-b4194f00bb92" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[63840497-1d06-4cb4-b68c-659d27d09326]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:21 devstack sudo[115642]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:21 devstack sudo[115649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b Aug 19 00:27:21 devstack sudo[115649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:21 devstack sudo[115648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 Aug 19 00:27:21 devstack sudo[115648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:21 devstack sudo[115649]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf.14cfa525-9c2b-4933-b734-3bf15176b82b" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-14cfa525-9c2b-4933-b734-3bf15176b82b" released by "_delete_snapshot" :: held 1.483s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-099808d4-5762-4ab7-b64c-3d05d26752bf" released by "delete_snapshot" :: held 1.506s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:21 devstack sudo[115648]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92" returned: 0 in 0.373s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:21 devstack sudo[115657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92 Aug 19 00:27:21 devstack sudo[115657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Created reservations ['a6086128-8b22-430f-82a7-93b2856d4925', 'd42054fe-24bc-469a-9bb7-8c53a823dcb5', 'f1da3259-7b28-4b8f-866c-6f15144eb560', '2b2bdf70-7fdc-4836-a62f-67b57db1e098'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:21 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-40368729-20ac-4974-93c2-80f6f79ad103 tempest-ProjectMemberTests-237211261 None] Lock "cinder-14cfa525-9c2b-4933-b734-3bf15176b82b-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:21 devstack sudo[115657]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-af457168-0625-4a51-b483-b4194f00bb92" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:21 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-af457168-0625-4a51-b483-b4194f00bb92" released by "delete_volume" :: held 0.654s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Created reservations ['8c621491-d121-488b-b9e7-0e0b90034937', '20c3ef69-2036-4c25-ba6a-2bd26b66ba86', 'e68f342d-a79e-4ec7-b5e9-8760b92efdd3', '8b601489-acf8-43f9-bd18-ab8192659c8e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:22 devstack sudo[115661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:22 devstack sudo[115661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-099808d4-5762-4ab7-b64c-3d05d26752bf-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Lock "cinder-099808d4-5762-4ab7-b64c-3d05d26752bf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-099808d4-5762-4ab7-b64c-3d05d26752bf" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-099808d4-5762-4ab7-b64c-3d05d26752bf" acquired by "delete_volume" :: waited 0.031s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:22 devstack sudo[115661]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.306s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:22 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Deleted volume successfully. Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfc6ed6-10a8-4861-8e06-67d895a6221a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Creating offline snapshot 17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 of volume 3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-82dd235b-473b-4933-9635-41f009f10b3d tempest-ProjectReaderTests-177271631 None] Lock "cinder-af457168-0625-4a51-b483-b4194f00bb92-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6dbb4-4e64-4653-a778-6c3a68df2eb0]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:22 devstack sudo[115664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf Aug 19 00:27:22 devstack sudo[115664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:22 devstack sudo[115665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 Aug 19 00:27:22 devstack sudo[115665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:22 devstack sudo[115664]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf" returned: 0 in 0.424s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:22 devstack sudo[115674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf Aug 19 00:27:22 devstack sudo[115674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:22 devstack sudo[115665]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881" returned: 0 in 0.434s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:22 devstack sudo[115676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 1G Aug 19 00:27:22 devstack sudo[115676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (531bdf76-cdcc-45ff-8274-de728c6b29a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26e78c9-e4e3-4e95-991f-7be4dc14acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:22 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26e78c9-e4e3-4e95-991f-7be4dc14acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520473833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580592ab-0fb7-4837-bee9-1eb1c76c4d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:23Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d94e7b7-1ee6-4de8-9127-40d93c59ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d94e7b7-1ee6-4de8-9127-40d93c59ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8bdd01-e481-4aee-8747-1bb7d4d4b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8bdd01-e481-4aee-8747-1bb7d4d4b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580592ab-0fb7-4837-bee9-1eb1c76c4d66', 'volume_name': 'volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b34a65-6fc5-474a-9598-54159db13d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b34a65-6fc5-474a-9598-54159db13d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c09a6d-be56-4273-96ae-eabbdca1e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Volume 580592ab-0fb7-4837-bee9-1eb1c76c4d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66', 'volume_size': 1} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:23 devstack sudo[115674]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-099808d4-5762-4ab7-b64c-3d05d26752bf" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-099808d4-5762-4ab7-b64c-3d05d26752bf" released by "delete_volume" :: held 0.745s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Created reservations ['338bd24e-b42c-4ad2-bb29-944be91376a6', '99c9edf9-2033-44c6-ae20-bb9e80e2d042', '189b72cf-5833-4535-8aa4-bb09c724c5e7', '7a981a97-0bde-486e-812a-cea0c6f173c1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:23 devstack sudo[115682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:23 devstack sudo[115682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:23 devstack sudo[115676]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 1G" returned: 0 in 0.436s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b280aca-3e04-4968-8dbf-e7a98e338881 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:23 devstack sudo[115684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b280aca-3e04-4968-8dbf-e7a98e338881 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 Aug 19 00:27:23 devstack sudo[115684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:23 devstack sudo[115682]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.277s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:23 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-417a6e57-cc44-4572-8da2-a6362b8d2f2d tempest-ProjectMemberTests-237211261 None] Lock "cinder-099808d4-5762-4ab7-b64c-3d05d26752bf-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:23 devstack sudo[115684]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b280aca-3e04-4968-8dbf-e7a98e338881 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" returned: 0 in 0.323s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:23 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 is being set with open permissions: ugo+rw Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:23 devstack sudo[115690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 Aug 19 00:27:23 devstack sudo[115690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (6e600a96-41a4-49ec-a78d-6e4f664e358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd45ba8-bf76-481a-a60f-7f7f445a89bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd45ba8-bf76-481a-a60f-7f7f445a89bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060277183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:24Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack sudo[115690]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462d5024-c569-415d-a58d-73ddca3f1145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462d5024-c569-415d-a58d-73ddca3f1145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5fbcda-38f2-4c87-901d-d7d7dd4655ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5fbcda-38f2-4c87-901d-d7d7dd4655ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d', 'volume_name': 'volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5307e-23cf-423d-a558-4f95daa9628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5307e-23cf-423d-a558-4f95daa9628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27df4124-0b1a-44c5-9f15-dfc45e7c9453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:23 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Volume c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d', 'volume_size': 1} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" returned: 0 in 0.308s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:23 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:24 devstack sudo[115693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info Aug 19 00:27:24 devstack sudo[115693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:24 devstack sudo[115693]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:24 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info is being set with open permissions: ugo+rw Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:24 devstack sudo[115696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info Aug 19 00:27:24 devstack sudo[115696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:24 devstack sudo[115696]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.info" returned: 0 in 0.235s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520473833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580592ab-0fb7-4837-bee9-1eb1c76c4d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:23Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Creating volume 580592ab-0fb7-4837-bee9-1eb1c76c4d66 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:24 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:24 devstack sudo[115699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 1073741824 Aug 19 00:27:24 devstack sudo[115699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:24 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7fbae405-3066-4f82-98d3-ff4f7195fe16 tempest-ProjectReaderTests-1289080493 None] Create snapshot completed successfully Aug 19 00:27:24 devstack sudo[115699]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 1073741824" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:24 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:24 devstack sudo[115705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 Aug 19 00:27:24 devstack sudo[115705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:25 devstack sudo[115705]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66" returned: 0 in 0.248s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060277183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:24Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Creating volume c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:25 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c09a6d-be56-4273-96ae-eabbdca1e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:25 devstack sudo[115708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d 1073741824 Aug 19 00:27:25 devstack sudo[115708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03394c55-de43-4f56-b12f-01396d176cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:25 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Volume volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 (580592ab-0fb7-4837-bee9-1eb1c76c4d66): created successfully Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03394c55-de43-4f56-b12f-01396d176cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (531bdf76-cdcc-45ff-8274-de728c6b29a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:25 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-90078e00-a9e9-458a-aebe-f6036c6021c8 tempest-ProjectReaderTests-177271631 None] Created volume successfully. Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-3b280aca-3e04-4968-8dbf-e7a98e338881" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-3b280aca-3e04-4968-8dbf-e7a98e338881" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Deleting offline snapshot 17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 of volume 3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] snapshot_file for this snap is: volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[264dc868-a606-4c3c-84d1-23dd9dd519e5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:25 devstack sudo[115708]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d 1073741824" returned: 0 in 0.455s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:25 devstack sudo[115720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 Aug 19 00:27:25 devstack sudo[115720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:25 devstack sudo[115723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d Aug 19 00:27:25 devstack sudo[115723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:25 devstack sudo[115720]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b280aca-3e04-4968-8dbf-e7a98e338881(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:25 devstack sudo[115723]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" returned: 0 in 0.270s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e929cf4-b41f-4ad2-8ef3-20c45f48ba37]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:25 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27df4124-0b1a-44c5-9f15-dfc45e7c9453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf3bc7d-8736-453a-8a77-21e3bf88db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:26 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Volume volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d (c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d): created successfully Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf3bc7d-8736-453a-8a77-21e3bf88db61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (6e600a96-41a4-49ec-a78d-6e4f664e358a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:26 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d877c46e-55d7-456f-8f0f-26b7a36bf80e tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-580592ab-0fb7-4837-bee9-1eb1c76c4d66-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:26 devstack sudo[115729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 Aug 19 00:27:26 devstack sudo[115729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Lock "cinder-580592ab-0fb7-4837-bee9-1eb1c76c4d66-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-quobyte-580592ab-0fb7-4837-bee9-1eb1c76c4d66" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-580592ab-0fb7-4837-bee9-1eb1c76c4d66" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[537026fe-400f-4f0f-8c80-58f17c6783c2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:26 devstack sudo[115731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 Aug 19 00:27:26 devstack sudo[115731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:26 devstack sudo[115729]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881" returned: 0 in 0.422s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:26 devstack sudo[115736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 Aug 19 00:27:26 devstack sudo[115736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:26 devstack sudo[115731]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66" returned: 0 in 0.404s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:26 devstack sudo[115741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66 Aug 19 00:27:26 devstack sudo[115741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:26 devstack sudo[115736]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" returned: 0 in 0.340s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:26 devstack sudo[115747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60 Aug 19 00:27:26 devstack sudo[115747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:26 devstack sudo[115741]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-580592ab-0fb7-4837-bee9-1eb1c76c4d66" returned: 0 in 0.253s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-580592ab-0fb7-4837-bee9-1eb1c76c4d66" released by "delete_volume" :: held 0.701s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Created reservations ['2860b542-c371-456f-b245-ae2bc81c978b', '5dfca7a3-114d-4429-8e83-c85ce9112f9c', '2b3a3c6e-c7b5-4ca9-88a9-c350b26c6e10', 'e26ae6da-b87b-4a25-9548-21db593aae5f'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:26 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:27 devstack sudo[115747]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881.17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" returned: 0 in 0.275s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:27 devstack sudo[115751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:27 devstack sudo[115751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60" released by "_delete_snapshot" :: held 1.543s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-3b280aca-3e04-4968-8dbf-e7a98e338881" released by "delete_snapshot" :: held 1.573s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Created reservations ['39236cbc-30c5-4c2a-b866-7cb10984d592', 'be3406a7-2cb1-4825-89df-302aa95c9444', 'b6f3f32b-f81f-4762-ba70-0ab25d111564', 'e24c8d82-5f34-43a4-b29b-f1a89cf44cfe'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:27 devstack sudo[115751]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Delete snapshot completed successfully. Aug 19 00:27:27 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Deleted volume successfully. Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Creating offline snapshot 20dc1078-0835-43a8-a017-171d8660e577 of volume c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-b69a2df1-7175-4355-ab6d-28b046a6a882 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-17da8fc5-0bab-4c64-a85d-d2c8ad0b2c60-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108501b-e147-4a7b-8009-66830e1884e4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4d6e7de4-716a-43cd-a5b5-19b8a5403391 tempest-ProjectReaderTests-177271631 None] Lock "cinder-580592ab-0fb7-4837-bee9-1eb1c76c4d66-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:27 devstack sudo[115754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d Aug 19 00:27:27 devstack sudo[115754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-3b280aca-3e04-4968-8dbf-e7a98e338881-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Lock "cinder-3b280aca-3e04-4968-8dbf-e7a98e338881-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-3b280aca-3e04-4968-8dbf-e7a98e338881" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:27 devstack sudo[115754]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" returned: 0 in 0.449s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:27 devstack sudo[115759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 1G Aug 19 00:27:27 devstack sudo[115759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-3b280aca-3e04-4968-8dbf-e7a98e338881" acquired by "delete_volume" :: waited 0.045s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (5c96a14b-e219-4b9c-ac42-4862a6f0332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578adf9d-6190-4266-92e8-e5447627d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9570d14a-b246-47c2-85b1-5c28ee1dc41c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578adf9d-6190-4266-92e8-e5447627d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733290030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb6aa45-0116-4d4a-84ef-202dd923821f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:28Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210bc610-ed36-4304-9b0f-6df8140f7a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210bc610-ed36-4304-9b0f-6df8140f7a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4401507-9f63-4ffc-b4b0-7cd62511b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4401507-9f63-4ffc-b4b0-7cd62511b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb6aa45-0116-4d4a-84ef-202dd923821f', 'volume_name': 'volume-fbb6aa45-0116-4d4a-84ef-202dd923821f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e03093-a721-4329-a2b7-eca6108bcafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e03093-a721-4329-a2b7-eca6108bcafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33a3424-4a1d-411e-8b55-70a208dfc8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:27 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Volume fbb6aa45-0116-4d4a-84ef-202dd923821f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb6aa45-0116-4d4a-84ef-202dd923821f', 'volume_size': 1} Aug 19 00:27:27 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:27 devstack sudo[115761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 Aug 19 00:27:27 devstack sudo[115761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:28 devstack sudo[115759]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 1G" returned: 0 in 0.399s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:28 devstack sudo[115768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 Aug 19 00:27:28 devstack sudo[115768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:28 devstack sudo[115761]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881" returned: 0 in 0.384s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:28 devstack sudo[115772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881 Aug 19 00:27:28 devstack sudo[115772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:28 devstack sudo[115768]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577" returned: 0 in 0.299s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:28 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 is being set with open permissions: ugo+rw Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:28 devstack sudo[115772]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:28 devstack sudo[115780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-3b280aca-3e04-4968-8dbf-e7a98e338881" returned: 0 in 0.253s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:28 devstack sudo[115780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-3b280aca-3e04-4968-8dbf-e7a98e338881" released by "delete_volume" :: held 0.716s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Created reservations ['473fba1e-6fc3-4f3d-985a-235e874495db', 'b7335fda-1777-4749-9798-1cead85bb254', '421a8ce0-db45-4527-a494-eaf1ecfb62e5', '618de132-d40e-4081-915f-9a88a2586b82'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:28 devstack sudo[115782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:28 devstack sudo[115782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:28 devstack sudo[115780]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:28 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info Aug 19 00:27:28 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:28 devstack sudo[115782]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.282s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:28 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Deleted volume successfully. Aug 19 00:27:28 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-6486db7a-749e-4f1d-a3b8-83286b3bdfde tempest-ProjectReaderTests-1289080493 None] Lock "cinder-3b280aca-3e04-4968-8dbf-e7a98e338881-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:29 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info" returned: 0 in 0.279s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:29 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info is being set with open permissions: ugo+rw Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:29 devstack sudo[115789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info Aug 19 00:27:29 devstack sudo[115789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:29 devstack sudo[115789]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.info" returned: 0 in 0.280s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733290030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb6aa45-0116-4d4a-84ef-202dd923821f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:28Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Creating volume fbb6aa45-0116-4d4a-84ef-202dd923821f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:29 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:29 devstack sudo[115792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f 1073741824 Aug 19 00:27:29 devstack sudo[115792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (e6cccfba-3c7e-43d3-9451-29b433fb4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b8e7a-d094-40e9-9ca5-0f3a5e39144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:29 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ff7d4a4f-47e9-4c13-be9c-9dc646b40383 tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b8e7a-d094-40e9-9ca5-0f3a5e39144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034399560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64ed1e0-39b4-4d48-b100-853edcc90530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:29Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfdf03f-f41f-4b5e-a107-cbcbcd1dca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfdf03f-f41f-4b5e-a107-cbcbcd1dca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc2e1be-9d45-462b-8c61-0d61369948cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc2e1be-9d45-462b-8c61-0d61369948cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64ed1e0-39b4-4d48-b100-853edcc90530', 'volume_name': 'volume-a64ed1e0-39b4-4d48-b100-853edcc90530', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f201e1c3-bf4d-425e-a199-658e2e723f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f201e1c3-bf4d-425e-a199-658e2e723f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49c7d31-284e-4bf2-bc6e-4ba701def577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:29 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Volume a64ed1e0-39b4-4d48-b100-853edcc90530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64ed1e0-39b4-4d48-b100-853edcc90530', 'volume_size': 1} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:29 devstack sudo[115792]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f 1073741824" returned: 0 in 0.426s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:29 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:29 devstack sudo[115798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f Aug 19 00:27:29 devstack sudo[115798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:30 devstack sudo[115798]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f" returned: 0 in 0.239s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034399560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64ed1e0-39b4-4d48-b100-853edcc90530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:29Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Creating volume a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:30 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33a3424-4a1d-411e-8b55-70a208dfc8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb6aa45-0116-4d4a-84ef-202dd923821f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:30 devstack sudo[115801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 1073741824 Aug 19 00:27:30 devstack sudo[115801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1749538-d610-4c10-a0c4-f18b3eaaf7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:30 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Volume volume-fbb6aa45-0116-4d4a-84ef-202dd923821f (fbb6aa45-0116-4d4a-84ef-202dd923821f): created successfully Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1749538-d610-4c10-a0c4-f18b3eaaf7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (5c96a14b-e219-4b9c-ac42-4862a6f0332e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bdb5c4b1-7f62-4dd6-958f-85daed7c25b1 tempest-ProjectReaderTests-177271631 None] Created volume successfully. Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-20dc1078-0835-43a8-a017-171d8660e577-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Lock "cinder-20dc1078-0835-43a8-a017-171d8660e577-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-20dc1078-0835-43a8-a017-171d8660e577" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-20dc1078-0835-43a8-a017-171d8660e577" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot 20dc1078-0835-43a8-a017-171d8660e577 of volume c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a153f4-8af8-4561-a9b6-87aba95791f4]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:30 devstack sudo[115801]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 1073741824" returned: 0 in 0.463s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:30 devstack sudo[115808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 Aug 19 00:27:30 devstack sudo[115808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:30 devstack sudo[115807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 Aug 19 00:27:30 devstack sudo[115807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:30 devstack sudo[115808]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49c7d31-284e-4bf2-bc6e-4ba701def577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64ed1e0-39b4-4d48-b100-853edcc90530', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab97da9-29a2-4518-a863-dd8af2254909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:30 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Volume volume-a64ed1e0-39b4-4d48-b100-853edcc90530 (a64ed1e0-39b4-4d48-b100-853edcc90530): created successfully Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab97da9-29a2-4518-a863-dd8af2254909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (e6cccfba-3c7e-43d3-9451-29b433fb4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:30 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-81dac01f-a9cc-4b49-a037-51645177556c tempest-ProjectReaderTests-1289080493 None] Created volume successfully. Aug 19 00:27:30 devstack sudo[115807]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577" returned: 0 in 0.395s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336f054-1758-43d5-8943-062541f9506b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:30 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-fbb6aa45-0116-4d4a-84ef-202dd923821f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Lock "cinder-fbb6aa45-0116-4d4a-84ef-202dd923821f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-quobyte-fbb6aa45-0116-4d4a-84ef-202dd923821f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-fbb6aa45-0116-4d4a-84ef-202dd923821f" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:31 devstack sudo[115817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d Aug 19 00:27:31 devstack sudo[115817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a45002-46cd-4fb5-a5af-e707a7da10e9]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:31 devstack sudo[115819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f Aug 19 00:27:31 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack sudo[115817]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" returned: 0 in 0.399s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:31 devstack sudo[115824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 Aug 19 00:27:31 devstack sudo[115824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:31 devstack sudo[115829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f Aug 19 00:27:31 devstack sudo[115829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Creating offline snapshot 465c4e16-8dd3-474f-84d9-ae1cf945052f of volume a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1980cf-1267-420c-875d-db5e670a391c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:31 devstack sudo[115824]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577" returned: 0 in 0.398s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:31 devstack sudo[115833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 Aug 19 00:27:31 devstack sudo[115833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack sudo[115829]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-fbb6aa45-0116-4d4a-84ef-202dd923821f" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-fbb6aa45-0116-4d4a-84ef-202dd923821f" released by "delete_volume" :: held 0.705s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:31 devstack sudo[115836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577 Aug 19 00:27:31 devstack sudo[115836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Created reservations ['ae62b970-a7ac-4cf4-9166-acf4e9ce8cd6', 'b4c57396-af38-4eca-a226-b491cea67152', '6d920015-ed35-4875-9a3a-fcf64babe95f', '8fc2a79f-e785-4e22-be88-ad5647d42a74'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:31 devstack sudo[115840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:31 devstack sudo[115840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:31 devstack sudo[115836]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d.20dc1078-0835-43a8-a017-171d8660e577" returned: 0 in 0.261s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:32 devstack sudo[115833]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530" returned: 0 in 0.408s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-20dc1078-0835-43a8-a017-171d8660e577" released by "_delete_snapshot" :: held 1.560s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" released by "delete_snapshot" :: held 1.586s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:32 devstack sudo[115846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f 1G Aug 19 00:27:32 devstack sudo[115846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Created reservations ['860c1114-dc59-4935-8111-d283ba595027', '5a918c71-d40d-4b12-8a26-bc593d1a5e9e', 'd7c47946-b86a-42e4-99d9-4e2b7e85bfc5', '96cd2f65-177c-44cd-9647-da2c2b47f581'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:32 devstack sudo[115840]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.278s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Deleted volume successfully. Aug 19 00:27:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9f4faff5-8b85-44c8-a15c-33185d6b6b2f tempest-ProjectMemberTests-237211261 None] Lock "cinder-20dc1078-0835-43a8-a017-171d8660e577-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-04e87e71-486a-448b-9cad-6f2093fa6af9 tempest-ProjectReaderTests-177271631 None] Lock "cinder-fbb6aa45-0116-4d4a-84ef-202dd923821f-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:32 devstack sudo[115846]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f 1G" returned: 0 in 0.465s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64ed1e0-39b4-4d48-b100-853edcc90530 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:32 devstack sudo[115853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64ed1e0-39b4-4d48-b100-853edcc90530 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f Aug 19 00:27:32 devstack sudo[115853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Lock "cinder-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (6892dec9-c5da-4784-8019-3cb20c490b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20be0aa-1469-494c-890b-79529d866586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20be0aa-1469-494c-890b-79529d866586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689763188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402fed1b-e558-4c83-8ffa-bfebc065310f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:33Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb348bc4-4cb3-4bb2-ab21-a057fe1fa1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb348bc4-4cb3-4bb2-ab21-a057fe1fa1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f433247d-df9a-49bf-87c9-92102c9d0ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f433247d-df9a-49bf-87c9-92102c9d0ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402fed1b-e558-4c83-8ffa-bfebc065310f', 'volume_name': 'volume-402fed1b-e558-4c83-8ffa-bfebc065310f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4316f7d-3246-49d2-be13-a5c4622adf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4316f7d-3246-49d2-be13-a5c4622adf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996e6c91-53fa-425c-a443-1c4a948f31ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:32 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Volume 402fed1b-e558-4c83-8ffa-bfebc065310f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402fed1b-e558-4c83-8ffa-bfebc065310f', 'volume_size': 1} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:32 devstack sudo[115853]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a64ed1e0-39b4-4d48-b100-853edcc90530 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f" returned: 0 in 0.311s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:32 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f is being set with open permissions: ugo+rw Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:32 devstack sudo[115858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f Aug 19 00:27:32 devstack sudo[115858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae6bb93-13fd-4490-a04d-247c8707e697]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:32 devstack sudo[115860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d Aug 19 00:27:32 devstack sudo[115860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:33 devstack sudo[115858]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:33 devstack sudo[115863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info Aug 19 00:27:33 devstack sudo[115863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:33 devstack sudo[115860]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:33 devstack sudo[115868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d Aug 19 00:27:33 devstack sudo[115868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:33 devstack sudo[115863]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info" returned: 0 in 0.268s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:33 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info is being set with open permissions: ugo+rw Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:33 devstack sudo[115871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info Aug 19 00:27:33 devstack sudo[115871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:33 devstack sudo[115868]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" returned: 0 in 0.249s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d" released by "delete_volume" :: held 0.671s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Created reservations ['0e09e81f-3983-493e-add3-5e439237a9bb', '1c8a5531-a441-4ffd-a3e4-2916970294e6', 'b65a8124-cb61-46a4-8434-18d7c552067f', 'b07cdc5c-27ef-4eb1-96ee-4981f8a8d938'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:33 devstack sudo[115871]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.info" returned: 0 in 0.296s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:33 devstack sudo[115875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:33 devstack sudo[115875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689763188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402fed1b-e558-4c83-8ffa-bfebc065310f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d0ad5ab2e4279ab8c08de02b78468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:33Z,use_quota=True,user_id='7cc62763d6dc4d289cb96f746c834753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Creating volume 402fed1b-e558-4c83-8ffa-bfebc065310f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:33 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:33 devstack sudo[115877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f 1073741824 Aug 19 00:27:33 devstack sudo[115877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1d2581a9-3fde-41f5-bbe1-f6737f59db09 tempest-ProjectReaderTests-1289080493 None] Create snapshot completed successfully Aug 19 00:27:33 devstack sudo[115875]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.268s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:33 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:33 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-9a8bd7b6-ba3d-4f54-aa35-e00d1cefc8d2 tempest-ProjectMemberTests-237211261 None] Lock "cinder-c5d926a2-9aa5-4ea6-ac7b-09256fc0e34d-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:34 devstack sudo[115877]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f 1073741824" returned: 0 in 0.482s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:34 devstack sudo[115884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f Aug 19 00:27:34 devstack sudo[115884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (d9c14187-326a-4989-a4a2-2345a014d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c617a3-07fe-4be7-9c42-4909281bac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c617a3-07fe-4be7-9c42-4909281bac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233871692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d688d4a7-a8bc-48e9-8502-90d4e8a6c66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:34Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b655c34b-496e-4d9f-ba9e-cbad5f0f97bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b655c34b-496e-4d9f-ba9e-cbad5f0f97bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3dfa23-d222-48ec-9ac7-0a432c969db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3dfa23-d222-48ec-9ac7-0a432c969db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd688d4a7-a8bc-48e9-8502-90d4e8a6c66f', 'volume_name': 'volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50474c19-c61a-49d0-8086-51c145fa4e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50474c19-c61a-49d0-8086-51c145fa4e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17befc8-170c-40cd-94a0-473b79d8411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Volume d688d4a7-a8bc-48e9-8502-90d4e8a6c66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f', 'volume_size': 1} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:34 devstack sudo[115884]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f" returned: 0 in 0.246s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233871692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d688d4a7-a8bc-48e9-8502-90d4e8a6c66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:34Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Creating volume d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:34 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996e6c91-53fa-425c-a443-1c4a948f31ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402fed1b-e558-4c83-8ffa-bfebc065310f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:34 devstack sudo[115887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f 1073741824 Aug 19 00:27:34 devstack sudo[115887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fa7aff-a4e1-48b6-89e2-73cf053c5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:34 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Volume volume-402fed1b-e558-4c83-8ffa-bfebc065310f (402fed1b-e558-4c83-8ffa-bfebc065310f): created successfully Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fa7aff-a4e1-48b6-89e2-73cf053c5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Flow 'volume_create_manager' (6892dec9-c5da-4784-8019-3cb20c490b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c0655679-632c-4063-8606-fd3da9bccf35 tempest-ProjectReaderTests-177271631 None] Created volume successfully. Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-465c4e16-8dd3-474f-84d9-ae1cf945052f-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-402fed1b-e558-4c83-8ffa-bfebc065310f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-465c4e16-8dd3-474f-84d9-ae1cf945052f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-a64ed1e0-39b4-4d48-b100-853edcc90530" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-a64ed1e0-39b4-4d48-b100-853edcc90530" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-465c4e16-8dd3-474f-84d9-ae1cf945052f" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Lock "cinder-402fed1b-e558-4c83-8ffa-bfebc065310f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-465c4e16-8dd3-474f-84d9-ae1cf945052f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Deleting offline snapshot 465c4e16-8dd3-474f-84d9-ae1cf945052f of volume a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] snapshot_file for this snap is: volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d7b608-c8ff-4e1c-96c9-92017768d122]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Acquiring lock "cinder-quobyte-402fed1b-e558-4c83-8ffa-bfebc065310f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-402fed1b-e558-4c83-8ffa-bfebc065310f" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[66985cde-7386-46e7-b6eb-fdaa791718b5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:34 devstack sudo[115887]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f 1073741824" returned: 0 in 0.535s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:35 devstack sudo[115893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f Aug 19 00:27:35 devstack sudo[115893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:35 devstack sudo[115895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f Aug 19 00:27:35 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:35 devstack sudo[115894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f Aug 19 00:27:35 devstack sudo[115894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:35 devstack sudo[115893]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:35 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a64ed1e0-39b4-4d48-b100-853edcc90530(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" returned: 0 in 0.292s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[881cd06b-14ec-494b-94c7-2d83720c8dc7]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17befc8-170c-40cd-94a0-473b79d8411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13286cd5-a9b8-4f38-b959-bdbbd9715ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:35 devstack sudo[115894]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f" returned: 0 in 0.391s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Volume volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f (d688d4a7-a8bc-48e9-8502-90d4e8a6c66f): created successfully Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13286cd5-a9b8-4f38-b959-bdbbd9715ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (d9c14187-326a-4989-a4a2-2345a014d42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:35 devstack sudo[115909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f Aug 19 00:27:35 devstack sudo[115909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:35 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-9d2292d5-8904-4705-a9e2-53fe41bd023d tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:35 devstack sudo[115908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 Aug 19 00:27:35 devstack sudo[115908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:35 devstack sudo[115909]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-402fed1b-e558-4c83-8ffa-bfebc065310f" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Lock "cinder-quobyte-402fed1b-e558-4c83-8ffa-bfebc065310f" released by "delete_volume" :: held 0.678s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Created reservations ['55fa8e80-9438-43d2-aeb8-975c2b3c572f', 'a6eb34e0-bc3b-4cb9-bedc-9c94b1aea033', '00d14a8e-b988-481b-b2ad-0701641ea262', '0492a9ff-216a-48fa-a24c-188a1fc7f9fb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:35 devstack sudo[115908]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530" returned: 0 in 0.389s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:35 devstack sudo[115917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f Aug 19 00:27:35 devstack sudo[115917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:35 devstack sudo[115919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:35 devstack sudo[115919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:36 devstack sudo[115919]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.256s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Deleted volume successfully. Aug 19 00:27:36 devstack sudo[115917]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f" returned: 0 in 0.338s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d80c8a17-fa12-4b78-aaae-e1540771edf5 tempest-ProjectReaderTests-177271631 None] Lock "cinder-402fed1b-e558-4c83-8ffa-bfebc065310f-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:36 devstack sudo[115925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f Aug 19 00:27:36 devstack sudo[115925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:36 devstack sudo[115925]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530.465c4e16-8dd3-474f-84d9-ae1cf945052f" returned: 0 in 0.255s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-465c4e16-8dd3-474f-84d9-ae1cf945052f" released by "_delete_snapshot" :: held 1.483s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-a64ed1e0-39b4-4d48-b100-853edcc90530" released by "delete_snapshot" :: held 1.536s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Created reservations ['0911e82d-4964-414d-b533-cd92d25e0af2', '392ea7f9-28ec-4faa-87d6-bf97db7122f6', '21dad669-8b01-486f-aad8-f2642b66ccac', '0f7c05e9-887b-4ac9-83c0-e74cf0de6415'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:36 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Delete snapshot completed successfully. Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Creating offline snapshot cb11607a-c016-4ce1-bf0e-abe47f09123b of volume d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-eb69baf9-00a8-4fbf-8e70-d58888600237 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-465c4e16-8dd3-474f-84d9-ae1cf945052f-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d215b-ca90-476a-a8ad-6cbd1264b80b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:36 devstack sudo[115928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f Aug 19 00:27:36 devstack sudo[115928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:36 devstack sudo[115928]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" returned: 0 in 0.385s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:36 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-a64ed1e0-39b4-4d48-b100-853edcc90530-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:36 devstack sudo[115933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b 1G Aug 19 00:27:36 devstack sudo[115933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Lock "cinder-a64ed1e0-39b4-4d48-b100-853edcc90530-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-a64ed1e0-39b4-4d48-b100-853edcc90530" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-a64ed1e0-39b4-4d48-b100-853edcc90530" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2df96b-02fa-4eb2-ab57-06057fb7ecda]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:37 devstack sudo[115935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 Aug 19 00:27:37 devstack sudo[115935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:37 devstack sudo[115933]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b 1G" returned: 0 in 0.504s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:37 devstack sudo[115942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b Aug 19 00:27:37 devstack sudo[115942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:37 devstack sudo[115935]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530" returned: 0 in 0.423s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:37 devstack sudo[115946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530 Aug 19 00:27:37 devstack sudo[115946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:37 devstack sudo[115942]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b" returned: 0 in 0.350s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:37 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b is being set with open permissions: ugo+rw Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:37 devstack sudo[115946]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-a64ed1e0-39b4-4d48-b100-853edcc90530" returned: 0 in 0.274s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:37 devstack sudo[115952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b Aug 19 00:27:37 devstack sudo[115952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-a64ed1e0-39b4-4d48-b100-853edcc90530" released by "delete_volume" :: held 0.769s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Created reservations ['12b29e45-cc9c-41a7-ba87-3c279d4f3032', '11c8f623-6317-4e17-b00a-c29970fa2d76', '1f334afa-e930-44e7-a9b4-d0c24b57b258', '82828cb8-f719-40ae-be60-155ee75df23e'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:37 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:37 devstack sudo[115954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:37 devstack sudo[115954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:38 devstack sudo[115952]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b" returned: 0 in 0.263s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:38 devstack sudo[115957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info Aug 19 00:27:38 devstack sudo[115957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:38 devstack sudo[115954]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.261s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Deleted volume successfully. Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2cf6cfb2-ca77-44fb-bc86-72aa8aa33e5a tempest-ProjectReaderTests-1289080493 None] Lock "cinder-a64ed1e0-39b4-4d48-b100-853edcc90530-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:38 devstack sudo[115957]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info" returned: 0 in 0.286s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:38 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info is being set with open permissions: ugo+rw Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:38 devstack sudo[115961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info Aug 19 00:27:38 devstack sudo[115961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (05421de9-c4b3-4bb8-95be-d5e895268d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:38 devstack sudo[115961]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3806bfb0-3662-487f-849b-1eec5d2162f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.info" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3806bfb0-3662-487f-849b-1eec5d2162f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128310766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30003a25-d54e-477d-9fc4-2a5b265b4d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:39Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e340073-5f2a-48ee-bd43-4958537e5e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e340073-5f2a-48ee-bd43-4958537e5e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcfe6ea-3be2-4d1b-a3a0-e61b97b981d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edcfe6ea-3be2-4d1b-a3a0-e61b97b981d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30003a25-d54e-477d-9fc4-2a5b265b4d03', 'volume_name': 'volume-30003a25-d54e-477d-9fc4-2a5b265b4d03', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3982ff-bf5e-4cc2-a816-8c73c43e4cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3982ff-bf5e-4cc2-a816-8c73c43e4cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433f98da-cff1-45bf-9972-0d35e9207cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:38 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Volume 30003a25-d54e-477d-9fc4-2a5b265b4d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30003a25-d54e-477d-9fc4-2a5b265b4d03', 'volume_size': 1} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128310766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30003a25-d54e-477d-9fc4-2a5b265b4d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:39Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Creating volume 30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:38 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:38 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:38 devstack sudo[115964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 1073741824 Aug 19 00:27:38 devstack sudo[115964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:38 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-552c7212-c8a9-4c4a-811b-3a8baa81f953 tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:27:39 devstack sudo[115964]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 1073741824" returned: 0 in 0.394s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:39 devstack sudo[115970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 Aug 19 00:27:39 devstack sudo[115970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:39 devstack sudo[115970]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03" returned: 0 in 0.249s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433f98da-cff1-45bf-9972-0d35e9207cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30003a25-d54e-477d-9fc4-2a5b265b4d03', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13eed3e7-dad2-4261-972b-6a2cee6cfde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:39 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Volume volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 (30003a25-d54e-477d-9fc4-2a5b265b4d03): created successfully Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13eed3e7-dad2-4261-972b-6a2cee6cfde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (05421de9-c4b3-4bb8-95be-d5e895268d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:39 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-66fd38f5-aeea-4882-909c-869c172b1180 tempest-ProjectReaderTests-1289080493 None] Created volume successfully. Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-cb11607a-c016-4ce1-bf0e-abe47f09123b-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Lock "cinder-cb11607a-c016-4ce1-bf0e-abe47f09123b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-cb11607a-c016-4ce1-bf0e-abe47f09123b" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-cb11607a-c016-4ce1-bf0e-abe47f09123b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot cb11607a-c016-4ce1-bf0e-abe47f09123b of volume d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4229d5-5abb-4457-a7b5-bc4e37e9bbb9]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Creating offline snapshot 11cce8a4-123a-44b1-98f5-4b517fa9fce3 of volume 30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ece256-ee7c-4c62-b247-31893c31826e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:39 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:39 devstack sudo[115973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b Aug 19 00:27:39 devstack sudo[115973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:39 devstack sudo[115974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 Aug 19 00:27:39 devstack sudo[115974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:40 devstack sudo[115973]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b" returned: 0 in 0.355s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc7859a-3b21-4a57-ae54-60e6e2a11a67]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:40 devstack sudo[115974]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03" returned: 0 in 0.378s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:40 devstack sudo[115984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 1G Aug 19 00:27:40 devstack sudo[115984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:40 devstack sudo[115983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f Aug 19 00:27:40 devstack sudo[115983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:40 devstack sudo[115983]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" returned: 0 in 0.369s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:40 devstack sudo[115994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b Aug 19 00:27:40 devstack sudo[115994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:40 devstack sudo[115984]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 1G" returned: 0 in 0.414s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:40 devstack sudo[115996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 Aug 19 00:27:40 devstack sudo[115996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:40 devstack sudo[115994]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b" returned: 0 in 0.330s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:40 devstack sudo[116004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b Aug 19 00:27:40 devstack sudo[116004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:40 devstack sudo[115996]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3" returned: 0 in 0.297s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:40 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 is being set with open permissions: ugo+rw Aug 19 00:27:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:40 devstack sudo[116006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 Aug 19 00:27:40 devstack sudo[116006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:41 devstack sudo[116004]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f.cb11607a-c016-4ce1-bf0e-abe47f09123b" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-cb11607a-c016-4ce1-bf0e-abe47f09123b" released by "_delete_snapshot" :: held 1.406s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" released by "delete_snapshot" :: held 1.449s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:41 devstack sudo[116006]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:41 devstack sudo[116010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info Aug 19 00:27:41 devstack sudo[116010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Created reservations ['679237ce-4743-4e34-8db9-a6c783205953', 'dfa7ec8a-5b88-42b5-a3ce-d7c7313573de', '69b8f2ac-0649-488e-9da3-8c4a4f164023', '2891f50f-2822-4c92-b18c-65d8079466bc'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-638bf6ba-4d4d-408d-b9b8-bbe747a26c74 tempest-ProjectMemberTests-237211261 None] Lock "cinder-cb11607a-c016-4ce1-bf0e-abe47f09123b-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:41 devstack sudo[116010]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:41 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info is being set with open permissions: ugo+rw Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:41 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info Aug 19 00:27:41 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:41 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.info" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:41 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b075731b-2cee-4c57-99ff-c38b88e06fc3 tempest-ProjectReaderTests-1289080493 None] Create snapshot completed successfully Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Lock "cinder-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-11cce8a4-123a-44b1-98f5-4b517fa9fce3-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493dca5-9e8f-45e0-8131-7ae41a1edd7b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-11cce8a4-123a-44b1-98f5-4b517fa9fce3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-30003a25-d54e-477d-9fc4-2a5b265b4d03" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-30003a25-d54e-477d-9fc4-2a5b265b4d03" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-11cce8a4-123a-44b1-98f5-4b517fa9fce3" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-11cce8a4-123a-44b1-98f5-4b517fa9fce3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Deleting offline snapshot 11cce8a4-123a-44b1-98f5-4b517fa9fce3 of volume 30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:42 devstack sudo[116017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] snapshot_file for this snap is: volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:42 devstack sudo[116017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0843824-db87-4a0c-98e9-6a53ed027ffd]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:42 devstack sudo[116019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 Aug 19 00:27:42 devstack sudo[116019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:42 devstack sudo[116017]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" returned: 0 in 0.360s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:42 devstack sudo[116024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f Aug 19 00:27:42 devstack sudo[116024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:42 devstack sudo[116019]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3" returned: 0 in 0.370s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30003a25-d54e-477d-9fc4-2a5b265b4d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[287cee4b-a1a0-4562-bcca-ef29e748304a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:42 devstack sudo[116024]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" returned: 0 in 0.252s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f" released by "delete_volume" :: held 0.686s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:42 devstack sudo[116029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 Aug 19 00:27:42 devstack sudo[116029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Created reservations ['095da80f-7d19-431f-b379-32688bfda9f1', 'cb92c2ba-b76a-454a-a63f-7d7e0dc30469', 'fc03b0cc-27d4-4ab4-935f-2eae7636cccf', '3d1eae2e-f579-4804-bf0e-024f45de7aeb'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:42 devstack sudo[116032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:42 devstack sudo[116032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:42 devstack sudo[116029]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03" returned: 0 in 0.368s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:42 devstack sudo[116037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 Aug 19 00:27:42 devstack sudo[116037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:43 devstack sudo[116032]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.269s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a850ad24-8930-4b01-af2c-6ad33a55cb47 tempest-ProjectMemberTests-237211261 None] Lock "cinder-d688d4a7-a8bc-48e9-8502-90d4e8a6c66f-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:43 devstack sudo[116037]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3" returned: 0 in 0.377s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:43 devstack sudo[116044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3 Aug 19 00:27:43 devstack sudo[116044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (96b6e09f-2d99-4037-8456-1fe371050e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d00a3ec-2311-4c15-bdd4-19ae9e0acda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:43 devstack sudo[116044]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03.11cce8a4-123a-44b1-98f5-4b517fa9fce3" returned: 0 in 0.263s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d00a3ec-2311-4c15-bdd4-19ae9e0acda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298065972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01965fa-487b-401b-8813-ab3211b16ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:43Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fb2aa2-50e7-47a2-84ce-8169f1ca4a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54fb2aa2-50e7-47a2-84ce-8169f1ca4a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ec854f-fba3-41ee-a418-a7c5e389b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ec854f-fba3-41ee-a418-a7c5e389b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01965fa-487b-401b-8813-ab3211b16ac5', 'volume_name': 'volume-c01965fa-487b-401b-8813-ab3211b16ac5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83186ad6-abc4-4914-a120-b91c0cd3a5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83186ad6-abc4-4914-a120-b91c0cd3a5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0939ad-b055-4fd1-9bd5-4444ee30e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:43 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Volume c01965fa-487b-401b-8813-ab3211b16ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01965fa-487b-401b-8813-ab3211b16ac5', 'volume_size': 1} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298065972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01965fa-487b-401b-8813-ab3211b16ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:43Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Creating volume c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:43 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-11cce8a4-123a-44b1-98f5-4b517fa9fce3" released by "_delete_snapshot" :: held 1.532s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-30003a25-d54e-477d-9fc4-2a5b265b4d03" released by "delete_snapshot" :: held 1.559s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:43 devstack sudo[116047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 1073741824 Aug 19 00:27:43 devstack sudo[116047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Created reservations ['f36ecb55-a8cf-4c85-8419-f85f8f66252d', 'f2dbaf70-c519-44a7-be56-2a5bd8f3d33a', '4380279c-6fd3-4620-a336-7b573e7c40a2', '70e85993-b549-4d54-bc22-6b3a7db01067'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:43 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Delete snapshot completed successfully. Aug 19 00:27:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2b963e93-34ce-4f06-900b-71b366a7014f tempest-ProjectReaderTests-1289080493 None] Lock "cinder-11cce8a4-123a-44b1-98f5-4b517fa9fce3-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:44 devstack sudo[116047]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 1073741824" returned: 0 in 0.398s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:44 devstack sudo[116053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 Aug 19 00:27:44 devstack sudo[116053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-30003a25-d54e-477d-9fc4-2a5b265b4d03-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-30003a25-d54e-477d-9fc4-2a5b265b4d03-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-30003a25-d54e-477d-9fc4-2a5b265b4d03" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-30003a25-d54e-477d-9fc4-2a5b265b4d03" acquired by "delete_volume" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6674e1a2-8ba1-4b3d-8f69-5d651e815008]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:44 devstack sudo[116053]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5" returned: 0 in 0.282s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0939ad-b055-4fd1-9bd5-4444ee30e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01965fa-487b-401b-8813-ab3211b16ac5', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9bf855-c1a7-435b-b3d5-d7d984e66b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:44 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Volume volume-c01965fa-487b-401b-8813-ab3211b16ac5 (c01965fa-487b-401b-8813-ab3211b16ac5): created successfully Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9bf855-c1a7-435b-b3d5-d7d984e66b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (96b6e09f-2d99-4037-8456-1fe371050e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8aef2b96-0bc7-4cb0-8338-51b61933f760 tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:44 devstack sudo[116056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 Aug 19 00:27:44 devstack sudo[116056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:44 devstack sudo[116056]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03" returned: 0 in 0.388s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Creating offline snapshot a53c7b52-6b8f-45c2-b6ea-596bd577fd2d of volume c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:44 devstack sudo[116062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03 Aug 19 00:27:44 devstack sudo[116062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[05939b20-efa8-4ceb-b9c1-c40307f10d8b]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:44 devstack sudo[116064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 Aug 19 00:27:44 devstack sudo[116064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:44 devstack sudo[116062]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-30003a25-d54e-477d-9fc4-2a5b265b4d03" returned: 0 in 0.248s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-30003a25-d54e-477d-9fc4-2a5b265b4d03" released by "delete_volume" :: held 0.699s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:44 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Created reservations ['242e3b7e-2721-4129-b519-1810aaa182b7', '9c7ac60a-12ca-4903-af1d-94019b144a1b', 'b03333ea-3553-4ed1-9350-c9a68251754e', 'c1118c2b-28bc-4592-9632-d6bb60008615'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:45 devstack sudo[116070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:45 devstack sudo[116070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:45 devstack sudo[116064]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:45 devstack sudo[116072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d 1G Aug 19 00:27:45 devstack sudo[116072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:45 devstack sudo[116070]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.268s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Deleted volume successfully. Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-a622619a-2cad-483e-ad11-7abbcac72502 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-30003a25-d54e-477d-9fc4-2a5b265b4d03-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:45 devstack sudo[116072]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d 1G" returned: 0 in 0.427s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01965fa-487b-401b-8813-ab3211b16ac5 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:45 devstack sudo[116079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01965fa-487b-401b-8813-ab3211b16ac5 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d Aug 19 00:27:45 devstack sudo[116079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (ce9981ec-1136-45a6-b271-52e67cfe4d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:45 devstack sudo[116079]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b533c7ba-1a9a-488c-b3db-263635ec6cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01965fa-487b-401b-8813-ab3211b16ac5 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" returned: 0 in 0.312s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:45 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d is being set with open permissions: ugo+rw Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b533c7ba-1a9a-488c-b3db-263635ec6cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255772021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01699b0f-d4eb-4fd4-b562-a3e11461f211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:46Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:45 devstack sudo[116085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d Aug 19 00:27:45 devstack sudo[116085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a0ba29-1c3a-4a9e-916b-26f16d0ce76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a0ba29-1c3a-4a9e-916b-26f16d0ce76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6989dce-df88-426a-9fa2-14fe862f4350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6989dce-df88-426a-9fa2-14fe862f4350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01699b0f-d4eb-4fd4-b562-a3e11461f211', 'volume_name': 'volume-01699b0f-d4eb-4fd4-b562-a3e11461f211', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b1e7cd-38be-4550-9727-f2989edfebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b1e7cd-38be-4550-9727-f2989edfebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64674a43-5418-45fe-bd9a-10c76e4d98ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:45 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Volume 01699b0f-d4eb-4fd4-b562-a3e11461f211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01699b0f-d4eb-4fd4-b562-a3e11461f211', 'volume_size': 1} Aug 19 00:27:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:46 devstack sudo[116085]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" returned: 0 in 0.253s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:46 devstack sudo[116088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info Aug 19 00:27:46 devstack sudo[116088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:46 devstack sudo[116088]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info" returned: 0 in 0.246s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:46 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info is being set with open permissions: ugo+rw Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:46 devstack sudo[116091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info Aug 19 00:27:46 devstack sudo[116091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:46 devstack sudo[116091]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.info" returned: 0 in 0.251s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255772021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01699b0f-d4eb-4fd4-b562-a3e11461f211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e11c1e8af7de40db822a188f6bd894d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:46Z,use_quota=True,user_id='31f6b4fbf4624b56a3c5f2b389cbdeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Creating volume 01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:46 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:46 devstack sudo[116094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 1073741824 Aug 19 00:27:46 devstack sudo[116094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:46 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-dd5cf219-81d4-4be2-a30a-571ff936ffe5 tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-a53c7b52-6b8f-45c2-b6ea-596bd577fd2d-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Lock "cinder-a53c7b52-6b8f-45c2-b6ea-596bd577fd2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-c01965fa-487b-401b-8813-ab3211b16ac5" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c01965fa-487b-401b-8813-ab3211b16ac5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot a53c7b52-6b8f-45c2-b6ea-596bd577fd2d of volume c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d11e8-41b6-4cd9-88df-0e5511636fe2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:46 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:47 devstack sudo[116099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d Aug 19 00:27:47 devstack sudo[116099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:47 devstack sudo[116094]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 1073741824" returned: 0 in 0.436s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:47 devstack sudo[116102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 Aug 19 00:27:47 devstack sudo[116102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:47 devstack sudo[116099]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01965fa-487b-401b-8813-ab3211b16ac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2040eca-d6aa-4cc3-9540-1fe85d6c00c3]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:47 devstack sudo[116102]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211" returned: 0 in 0.258s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64674a43-5418-45fe-bd9a-10c76e4d98ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01699b0f-d4eb-4fd4-b562-a3e11461f211', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae8ae05-059a-4f78-a3d6-efdffb415277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:47 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Volume volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 (01699b0f-d4eb-4fd4-b562-a3e11461f211): created successfully Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae8ae05-059a-4f78-a3d6-efdffb415277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Flow 'volume_create_manager' (ce9981ec-1136-45a6-b271-52e67cfe4d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:47 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-fec3fa93-7d75-4946-ab23-5fe718b88c2e tempest-ProjectReaderTests-1289080493 None] Created volume successfully. Aug 19 00:27:47 devstack sudo[116108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 Aug 19 00:27:47 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:47 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5" returned: 0 in 0.371s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:47 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:47 devstack sudo[116113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d Aug 19 00:27:47 devstack sudo[116113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Creating offline snapshot 948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 of volume 01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:48 devstack sudo[116113]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" returned: 0 in 0.383s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[707e1792-87eb-4937-8e68-0526cdda1a1a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:48 devstack sudo[116118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d Aug 19 00:27:48 devstack sudo[116118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:48 devstack sudo[116119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 Aug 19 00:27:48 devstack sudo[116119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:48 devstack sudo[116118]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5.a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-a53c7b52-6b8f-45c2-b6ea-596bd577fd2d" released by "_delete_snapshot" :: held 1.473s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c01965fa-487b-401b-8813-ab3211b16ac5" released by "delete_snapshot" :: held 1.495s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Created reservations ['6f4c3960-cd3a-47fa-ac4a-6532cfdfb4a6', 'f5f38c98-18ef-4f68-a3c1-e569204bf933', '575f131f-138a-4cb8-8dc0-a11031eeef2c', '8a88a5de-590f-44e1-a67b-1487c3ed2482'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:48 devstack sudo[116119]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211" returned: 0 in 0.374s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:48 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-19b2ee43-d81b-4e97-a385-75ca214a01a4 tempest-ProjectMemberTests-237211261 None] Lock "cinder-a53c7b52-6b8f-45c2-b6ea-596bd577fd2d-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:48 devstack sudo[116126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 1G Aug 19 00:27:48 devstack sudo[116126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:48 devstack sudo[116126]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 1G" returned: 0 in 0.377s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:48 devstack sudo[116131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 Aug 19 00:27:48 devstack sudo[116131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:48 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-c01965fa-487b-401b-8813-ab3211b16ac5-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Lock "cinder-c01965fa-487b-401b-8813-ab3211b16ac5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-c01965fa-487b-401b-8813-ab3211b16ac5" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c01965fa-487b-401b-8813-ab3211b16ac5" acquired by "delete_volume" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03a9ad-25af-42e6-b04e-3514b95af2a2]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:49 devstack sudo[116131]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" returned: 0 in 0.317s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:49 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 is being set with open permissions: ugo+rw Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:49 devstack sudo[116137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 Aug 19 00:27:49 devstack sudo[116137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:49 devstack sudo[116136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 Aug 19 00:27:49 devstack sudo[116136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:49 devstack sudo[116137]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:49 devstack sudo[116143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info Aug 19 00:27:49 devstack sudo[116143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:49 devstack sudo[116136]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5" returned: 0 in 0.356s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:49 devstack sudo[116146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5 Aug 19 00:27:49 devstack sudo[116146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:49 devstack sudo[116143]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info" returned: 0 in 0.261s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:49 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info is being set with open permissions: ugo+rw Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:49 devstack sudo[116149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info Aug 19 00:27:49 devstack sudo[116149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:49 devstack sudo[116146]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-c01965fa-487b-401b-8813-ab3211b16ac5" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c01965fa-487b-401b-8813-ab3211b16ac5" released by "delete_volume" :: held 0.680s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Created reservations ['2b1b51f4-280b-458a-a058-c030fc3f72ab', '8d141711-279d-4fb0-bdac-66f4d99dabc1', 'ff0cace0-1ef2-4c6b-8cac-1c658332e374', 'd4a0ce1d-9c09-45b4-ad26-54befdaf73b1'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:49 devstack sudo[116152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:49 devstack sudo[116152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:49 devstack sudo[116149]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.info" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:49 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:49 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-11158b35-c603-47ea-a32e-5ba7a67c200b tempest-ProjectReaderTests-1289080493 None] Create snapshot completed successfully Aug 19 00:27:50 devstack sudo[116152]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.277s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:50 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-948dff13-8f87-4aa5-8ec9-f547bd4cb5c7-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-bbfb684b-49df-403e-8243-877990bc87aa tempest-ProjectMemberTests-237211261 None] Lock "cinder-c01965fa-487b-401b-8813-ab3211b16ac5-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-948dff13-8f87-4aa5-8ec9-f547bd4cb5c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-01699b0f-d4eb-4fd4-b562-a3e11461f211" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-01699b0f-d4eb-4fd4-b562-a3e11461f211" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Deleting offline snapshot 948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 of volume 01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] snapshot_file for this snap is: volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b804613-8f61-4300-83f9-3c078e4ee6d5]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:50 devstack sudo[116156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 Aug 19 00:27:50 devstack sudo[116156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (2d8357b8-39f7-4ac6-9a10-f4ff71351715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217757d1-c457-4825-9387-0e588542811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217757d1-c457-4825-9387-0e588542811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227253597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3f7793-7eb0-46ec-8dcf-24c1a86fca71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:51Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c8de1e-f5ca-4456-8a9f-296b8312cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c8de1e-f5ca-4456-8a9f-296b8312cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cba2829-0ecc-4517-81f1-3ddd7ccd3798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cba2829-0ecc-4517-81f1-3ddd7ccd3798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3f7793-7eb0-46ec-8dcf-24c1a86fca71', 'volume_name': 'volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b15421-9e59-45a8-a373-5dd1cfb508c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b15421-9e59-45a8-a373-5dd1cfb508c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09545cec-1067-4584-bd23-fcb8d5669d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:50 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Volume ea3f7793-7eb0-46ec-8dcf-24c1a86fca71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71', 'volume_size': 1} Aug 19 00:27:50 devstack sudo[116156]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227253597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3f7793-7eb0-46ec-8dcf-24c1a86fca71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:51Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Creating volume ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:50 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" returned: 0 in 0.423s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01699b0f-d4eb-4fd4-b562-a3e11461f211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:50 devstack sudo[116161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 1073741824 Aug 19 00:27:50 devstack sudo[116161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e207475e-23bc-4005-a5dd-bdd143c66eac]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:50 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:50 devstack sudo[116163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 Aug 19 00:27:50 devstack sudo[116163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:51 devstack sudo[116161]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 1073741824" returned: 0 in 0.418s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:51 devstack sudo[116163]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211" returned: 0 in 0.394s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:51 devstack sudo[116171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 Aug 19 00:27:51 devstack sudo[116171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:51 devstack sudo[116172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 Aug 19 00:27:51 devstack sudo[116172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:51 devstack sudo[116172]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" returned: 0 in 0.294s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09545cec-1067-4584-bd23-fcb8d5669d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180f61af-d19b-46c4-ad02-b03c0102b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:51 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Volume volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 (ea3f7793-7eb0-46ec-8dcf-24c1a86fca71): created successfully Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180f61af-d19b-46c4-ad02-b03c0102b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (2d8357b8-39f7-4ac6-9a10-f4ff71351715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:51 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-954c51a2-ec46-4281-9b63-917bea2295a8 tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:51 devstack sudo[116171]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" returned: 0 in 0.433s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:51 devstack sudo[116181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7 Aug 19 00:27:51 devstack sudo[116181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Creating offline snapshot c8b2916b-901c-4bd8-84d1-68ec117c6c39 of volume ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f21634-ca49-4eb1-98f6-d15a9b8de5bc]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:51 devstack sudo[116181]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211.948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" returned: 0 in 0.285s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-948dff13-8f87-4aa5-8ec9-f547bd4cb5c7" released by "_delete_snapshot" :: held 1.643s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-01699b0f-d4eb-4fd4-b562-a3e11461f211" released by "delete_snapshot" :: held 1.669s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:51 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Created reservations ['20f75c86-c1d7-4e29-8da7-8bc8aad223b8', 'ea26c015-1385-40fa-b4e5-664f5aa4b245', 'b80ce869-4645-4c89-b3fa-7290cb436c16', 'c503207a-f7d1-4689-a854-9b9affc255d0'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:51 devstack sudo[116184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 Aug 19 00:27:51 devstack sudo[116184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:52 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Delete snapshot completed successfully. Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-1487fef3-64fb-4714-953e-8fd6743ff3f5 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-948dff13-8f87-4aa5-8ec9-f547bd4cb5c7-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:52 devstack sudo[116184]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" returned: 0 in 0.364s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:52 devstack sudo[116190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 1G Aug 19 00:27:52 devstack sudo[116190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-01699b0f-d4eb-4fd4-b562-a3e11461f211-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-01699b0f-d4eb-4fd4-b562-a3e11461f211-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "cinder-quobyte-01699b0f-d4eb-4fd4-b562-a3e11461f211" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-01699b0f-d4eb-4fd4-b562-a3e11461f211" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70b092-bf8b-4ed7-9638-3fa08e80e0ab]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:52 devstack sudo[116195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 Aug 19 00:27:52 devstack sudo[116195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:52 devstack sudo[116190]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 1G" returned: 0 in 0.419s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:52 devstack sudo[116197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 Aug 19 00:27:52 devstack sudo[116197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:52 devstack sudo[116195]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211" returned: 0 in 0.402s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:52 devstack sudo[116204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211 Aug 19 00:27:52 devstack sudo[116204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:52 devstack sudo[116197]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:52 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 is being set with open permissions: ugo+rw Aug 19 00:27:52 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:52 devstack sudo[116208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 Aug 19 00:27:52 devstack sudo[116208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:53 devstack sudo[116204]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-01699b0f-d4eb-4fd4-b562-a3e11461f211" returned: 0 in 0.258s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-quobyte-01699b0f-d4eb-4fd4-b562-a3e11461f211" released by "delete_volume" :: held 0.727s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:53 devstack sudo[116208]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Created reservations ['4aacc0bd-a623-4d16-a8bf-54fa9920206f', '976c34e7-f8b9-4af9-8593-bf0d0e907da1', '0f30cf1c-ceb4-4ec3-b4f5-87c60de4c045', '02114578-3327-4179-8950-a1e5bbfc3bad'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39" returned: 0 in 0.262s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:53 devstack sudo[116212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info Aug 19 00:27:53 devstack sudo[116212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:53 devstack sudo[116214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:53 devstack sudo[116214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:53 devstack sudo[116212]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info" returned: 0 in 0.259s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:53 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info is being set with open permissions: ugo+rw Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:53 devstack sudo[116217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info Aug 19 00:27:53 devstack sudo[116217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:53 devstack sudo[116214]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.255s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Deleted volume successfully. Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-d7bb99d4-3d57-464b-9e7c-c1921680d8b8 tempest-ProjectReaderTests-1289080493 None] Lock "cinder-01699b0f-d4eb-4fd4-b562-a3e11461f211-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:53 devstack sudo[116217]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.info" returned: 0 in 0.258s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:53 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-7a438784-46e1-4bed-8683-f3cf1588e873 tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-c8b2916b-901c-4bd8-84d1-68ec117c6c39-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Lock "cinder-c8b2916b-901c-4bd8-84d1-68ec117c6c39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-c8b2916b-901c-4bd8-84d1-68ec117c6c39" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c8b2916b-901c-4bd8-84d1-68ec117c6c39" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:53 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot c8b2916b-901c-4bd8-84d1-68ec117c6c39 of volume ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0a0b92-1ff2-4df8-aa6e-0c6fbc645788]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:54 devstack sudo[116221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 Aug 19 00:27:54 devstack sudo[116221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:54 devstack sudo[116221]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39" returned: 0 in 0.387s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e06cd57-47fc-4416-9a84-431568e93765]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:54 devstack sudo[116226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 Aug 19 00:27:54 devstack sudo[116226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:54 devstack sudo[116226]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" returned: 0 in 0.404s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:54 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:54 devstack sudo[116233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 Aug 19 00:27:54 devstack sudo[116233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:55 devstack sudo[116233]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39" returned: 0 in 0.379s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:55 devstack sudo[116238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39 Aug 19 00:27:55 devstack sudo[116238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:55 devstack sudo[116238]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71.c8b2916b-901c-4bd8-84d1-68ec117c6c39" returned: 0 in 0.249s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-c8b2916b-901c-4bd8-84d1-68ec117c6c39" released by "_delete_snapshot" :: held 1.529s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" released by "delete_snapshot" :: held 1.555s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Created reservations ['77045fee-1c6b-4bdf-a0a8-71c10a01df41', 'b0fbeb88-e1bf-440f-9ed6-7bec62d21c4d', '18d934a0-266f-41d2-9944-ebe46e6876a3', 'be09c593-0f57-49d1-a1ec-d74424eba652'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:55 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:27:55 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-457dfc6f-8c11-4d47-8860-1f51e4e34f38 tempest-ProjectMemberTests-237211261 None] Lock "cinder-c8b2916b-901c-4bd8-84d1-68ec117c6c39-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Lock "cinder-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[357be294-a13c-4493-b9a6-d9536962596a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:56 devstack sudo[116241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 Aug 19 00:27:56 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:56 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" returned: 0 in 0.377s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:56 devstack sudo[116246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71 Aug 19 00:27:56 devstack sudo[116246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:56 devstack sudo[116246]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" returned: 0 in 0.266s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71" released by "delete_volume" :: held 0.703s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Created reservations ['178d8d49-7304-4a42-836f-6b86a3db88ac', '58fa5dc1-2dc1-4866-a115-aeab1f3889fc', 'd5b483dd-b531-49bf-84ef-2d58fc709b33', 'ba4af0e6-a425-407b-b200-bcb2b6489964'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:56 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:57 devstack sudo[116249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:27:57 devstack sudo[116249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:57 devstack sudo[116249]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.249s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:27:57 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-46f626a1-8625-4d41-94a0-8e96b27ac990 tempest-ProjectMemberTests-237211261 None] Lock "cinder-ea3f7793-7eb0-46ec-8dcf-24c1a86fca71-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (6bc9f602-7fae-40b5-b6d2-53d12428ba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d03167f-c146-4ca9-af70-dd52c1cb0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d03167f-c146-4ca9-af70-dd52c1cb0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873911125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ef0d18-e5fe-421c-b472-5bef371f8cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:58Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe94b3eb-d700-44a8-8915-b293a0aafca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe94b3eb-d700-44a8-8915-b293a0aafca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b0a883-49dc-4869-aac4-b10ae7b15fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b0a883-49dc-4869-aac4-b10ae7b15fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ef0d18-e5fe-421c-b472-5bef371f8cec', 'volume_name': 'volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56cc766-8e7a-4ca4-a942-8f69827e507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56cc766-8e7a-4ca4-a942-8f69827e507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2ed108-4cfa-4c3c-865a-6ba2c9ea7720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:57 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Volume e2ef0d18-e5fe-421c-b472-5bef371f8cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec', 'volume_size': 1} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873911125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ef0d18-e5fe-421c-b472-5bef371f8cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:27:58Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Creating volume e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:27:57 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:27:57 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:57 devstack sudo[116252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec 1073741824 Aug 19 00:27:57 devstack sudo[116252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:58 devstack sudo[116252]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec 1073741824" returned: 0 in 0.466s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:58 devstack sudo[116258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec Aug 19 00:27:58 devstack sudo[116258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:58 devstack sudo[116258]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec" returned: 0 in 0.255s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2ed108-4cfa-4c3c-865a-6ba2c9ea7720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359979de-2925-4248-92bd-3bb784c162e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:27:58 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Volume volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec (e2ef0d18-e5fe-421c-b472-5bef371f8cec): created successfully Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359979de-2925-4248-92bd-3bb784c162e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (6bc9f602-7fae-40b5-b6d2-53d12428ba2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:27:58 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-c2309c69-ff43-43d6-90a1-95db01188552 tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Creating offline snapshot de84802e-c156-46fc-a01c-3f107349ada1 of volume e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f815a92-cd4a-4651-9771-174bf4700cfa]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:27:58 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:59 devstack sudo[116261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec Aug 19 00:27:59 devstack sudo[116261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:59 devstack sudo[116261]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec" returned: 0 in 0.363s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:59 devstack sudo[116266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 1G Aug 19 00:27:59 devstack sudo[116266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:59 devstack sudo[116266]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 1G" returned: 0 in 0.386s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:59 devstack sudo[116271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 Aug 19 00:27:59 devstack sudo[116271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:27:59 devstack sudo[116271]: pam_unix(sudo:session): session closed for user root Aug 19 00:27:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1" returned: 0 in 0.317s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:27:59 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 is being set with open permissions: ugo+rw Aug 19 00:27:59 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:27:59 devstack sudo[116277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 Aug 19 00:27:59 devstack sudo[116277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:00 devstack sudo[116277]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1" returned: 0 in 0.254s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:00 devstack sudo[116280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info Aug 19 00:28:00 devstack sudo[116280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:00 devstack sudo[116280]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info" returned: 0 in 0.244s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:00 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info is being set with open permissions: ugo+rw Aug 19 00:28:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:00 devstack sudo[116283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info Aug 19 00:28:00 devstack sudo[116283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:00 devstack sudo[116283]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.info" returned: 0 in 0.240s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:00 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:00 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-b73dbda6-88bb-4ea9-b464-14358ef560c3 tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-de84802e-c156-46fc-a01c-3f107349ada1-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Lock "cinder-de84802e-c156-46fc-a01c-3f107349ada1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-e2ef0d18-e5fe-421c-b472-5bef371f8cec" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-e2ef0d18-e5fe-421c-b472-5bef371f8cec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-de84802e-c156-46fc-a01c-3f107349ada1" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-de84802e-c156-46fc-a01c-3f107349ada1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot de84802e-c156-46fc-a01c-3f107349ada1 of volume e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa7827-c3a4-418a-a1e2-4fc6b8f1dd1c]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:01 devstack sudo[116286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 Aug 19 00:28:01 devstack sudo[116286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:01 devstack sudo[116286]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[708cf75f-5650-4934-94b9-22234ffff66a]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:01 devstack sudo[116291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec Aug 19 00:28:01 devstack sudo[116291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:01 devstack sudo[116291]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec" returned: 0 in 0.376s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:01 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:01 devstack sudo[116297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 Aug 19 00:28:01 devstack sudo[116297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:02 devstack sudo[116297]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1" returned: 0 in 0.360s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:02 devstack sudo[116304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1 Aug 19 00:28:02 devstack sudo[116304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:02 devstack sudo[116304]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec.de84802e-c156-46fc-a01c-3f107349ada1" returned: 0 in 0.267s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-de84802e-c156-46fc-a01c-3f107349ada1" released by "_delete_snapshot" :: held 1.450s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-e2ef0d18-e5fe-421c-b472-5bef371f8cec" released by "delete_snapshot" :: held 1.472s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=204,cinder:INSERT=67,cinder:UPDATE=272,cinder:DELETE=20 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=201,cinder:INSERT=77,cinder:UPDATE=263,cinder:DELETE=25 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Created reservations ['df411dcd-b4ff-4890-a6ae-1b27b7a3e806', '28074c88-0901-4156-93bf-c13d13fa39a1', '7fdd3580-b79d-4018-b1ba-60cdac7ad502', 'ab575030-1098-4fab-abfe-089a1a2d89c6'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:02 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:28:02 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-ef3ba9a3-73ba-411f-9245-7daa7dede347 tempest-ProjectMemberTests-237211261 None] Lock "cinder-de84802e-c156-46fc-a01c-3f107349ada1-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-e2ef0d18-e5fe-421c-b472-5bef371f8cec-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Lock "cinder-e2ef0d18-e5fe-421c-b472-5bef371f8cec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-e2ef0d18-e5fe-421c-b472-5bef371f8cec" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-e2ef0d18-e5fe-421c-b472-5bef371f8cec" acquired by "delete_volume" :: waited 0.018s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b62c438-a70a-4dc9-9582-583eccac4dfc]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:03 devstack sudo[116307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec Aug 19 00:28:03 devstack sudo[116307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:03 devstack sudo[116307]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec" returned: 0 in 0.374s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:03 devstack sudo[116313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec Aug 19 00:28:03 devstack sudo[116313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:03 devstack sudo[116313]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-e2ef0d18-e5fe-421c-b472-5bef371f8cec" returned: 0 in 0.250s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:03 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-e2ef0d18-e5fe-421c-b472-5bef371f8cec" released by "delete_volume" :: held 0.689s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Created reservations ['fbfe68ee-5c18-44f5-8e90-f306050d353a', 'a745afd8-9055-4e23-a4be-b33815ed71b9', '606c0116-07a4-4ce9-8468-6d2a5fe60370', 'f55bbe09-f1c2-4cc4-a54d-9ece492d0487'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:04 devstack sudo[116316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:28:04 devstack sudo[116316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:04 devstack sudo[116316]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.257s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:28:04 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-2aebf1eb-6935-4c3b-9454-794fe6500677 tempest-ProjectMemberTests-237211261 None] Lock "cinder-e2ef0d18-e5fe-421c-b472-5bef371f8cec-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (ecf8c663-27ff-48b1-9715-a45afeb24371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa2fce8-bbab-4405-b202-e47b9ca401f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa2fce8-bbab-4405-b202-e47b9ca401f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604510550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74e920e-5484-49a9-b19a-fe6d3fc19739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:28:05Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5746f666-f18d-40f8-a4ea-14588fc6c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5746f666-f18d-40f8-a4ea-14588fc6c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86da4ad-8acc-48e7-8900-e80ae540b513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86da4ad-8acc-48e7-8900-e80ae540b513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74e920e-5484-49a9-b19a-fe6d3fc19739', 'volume_name': 'volume-d74e920e-5484-49a9-b19a-fe6d3fc19739', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e597661-a855-4a42-a907-78661c243599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e597661-a855-4a42-a907-78661c243599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1464f3b-b92c-45be-b9a9-2e77ceab38c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:04 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Volume d74e920e-5484-49a9-b19a-fe6d3fc19739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74e920e-5484-49a9-b19a-fe6d3fc19739', 'volume_size': 1} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604510550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74e920e-5484-49a9-b19a-fe6d3fc19739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77cd62103fa4a148bb457bc3aa51338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:28:05Z,use_quota=True,user_id='bfc0350b4158453787b9e5ccfa8327ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Creating volume d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:28:04 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:28:04 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:04 devstack sudo[116319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 1073741824 Aug 19 00:28:04 devstack sudo[116319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:05 devstack sudo[116319]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 1073741824" returned: 0 in 0.457s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:05 devstack sudo[116325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 Aug 19 00:28:05 devstack sudo[116325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:05 devstack sudo[116325]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1464f3b-b92c-45be-b9a9-2e77ceab38c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74e920e-5484-49a9-b19a-fe6d3fc19739', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec61438-65ec-42dc-a37d-5a137f376c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:05 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Volume volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 (d74e920e-5484-49a9-b19a-fe6d3fc19739): created successfully Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec61438-65ec-42dc-a37d-5a137f376c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Flow 'volume_create_manager' (ecf8c663-27ff-48b1-9715-a45afeb24371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:28:05 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-f6d63fa5-b4ed-4da8-85d5-9beab946558e tempest-ProjectMemberTests-237211261 None] Created volume successfully. Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:05 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Creating offline snapshot ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 of volume d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[065227b9-2181-47ae-bb36-f534256be4eb]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:06 devstack sudo[116328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 Aug 19 00:28:06 devstack sudo[116328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:06 devstack sudo[116328]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739" returned: 0 in 0.354s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:06 devstack sudo[116333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 1G Aug 19 00:28:06 devstack sudo[116333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:06 devstack sudo[116333]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 1G" returned: 0 in 0.427s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:06 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:06 devstack sudo[116339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 Aug 19 00:28:06 devstack sudo[116339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:07 devstack sudo[116339]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" returned: 0 in 0.310s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:07 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 is being set with open permissions: ugo+rw Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:07 devstack sudo[116344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 Aug 19 00:28:07 devstack sudo[116344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:07 devstack sudo[116344]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" returned: 0 in 0.251s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:07 devstack sudo[116347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info Aug 19 00:28:07 devstack sudo[116347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:07 devstack sudo[116347]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info" returned: 0 in 0.245s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:07 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info is being set with open permissions: ugo+rw Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:07 devstack sudo[116350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info Aug 19 00:28:07 devstack sudo[116350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:07 devstack sudo[116350]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.info" returned: 0 in 0.244s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:07 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:07 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-0f963b85-d914-4518-92fe-735383cae189 tempest-ProjectMemberTests-237211261 None] Create snapshot completed successfully Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Lock "cinder-ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-d74e920e-5484-49a9-b19a-fe6d3fc19739" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d74e920e-5484-49a9-b19a-fe6d3fc19739" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Deleting offline snapshot ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 of volume d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] snapshot_file for this snap is: volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bef2e2-786b-427e-9244-fc069bc72850]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:08 devstack sudo[116353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 Aug 19 00:28:08 devstack sudo[116353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:08 devstack sudo[116353]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" returned: 0 in 0.376s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74e920e-5484-49a9-b19a-fe6d3fc19739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb427f-0420-48ae-9a0a-f360175fcb8f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:08 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:08 devstack sudo[116358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 Aug 19 00:28:08 devstack sudo[116358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:09 devstack sudo[116358]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739" returned: 0 in 0.362s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:09 devstack sudo[116363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 Aug 19 00:28:09 devstack sudo[116363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:09 devstack sudo[116363]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" returned: 0 in 0.350s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:09 devstack sudo[116368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85 Aug 19 00:28:09 devstack sudo[116368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:09 devstack sudo[116368]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739.ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" returned: 0 in 0.275s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85" released by "_delete_snapshot" :: held 1.469s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d74e920e-5484-49a9-b19a-fe6d3fc19739" released by "delete_snapshot" :: held 1.496s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Created reservations ['49a5c529-4f94-4e46-bb7e-5d850e5a2c11', '1fef384f-1249-48a7-9dbd-3a909a7f8331', '87684ed0-0f74-4305-9a4d-088274752cb4', '5a1d5257-289b-4b51-9f8c-0536ec61e861'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:09 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Delete snapshot completed successfully. Aug 19 00:28:09 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5bc2c97b-c378-4dab-a181-8a50211ac250 tempest-ProjectMemberTests-237211261 None] Lock "cinder-ecc2a5fb-8d7d-4fdc-87f2-0fe4e5e2ac85-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-d74e920e-5484-49a9-b19a-fe6d3fc19739-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Lock "cinder-d74e920e-5484-49a9-b19a-fe6d3fc19739-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Acquiring lock "cinder-quobyte-d74e920e-5484-49a9-b19a-fe6d3fc19739" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d74e920e-5484-49a9-b19a-fe6d3fc19739" acquired by "delete_volume" :: waited 0.016s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e73e5f4-f61b-43ad-be21-f27a2a8c2fef]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:10 devstack sudo[116371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 Aug 19 00:28:10 devstack sudo[116371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:10 devstack sudo[116371]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:10 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:10 devstack sudo[116376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739 Aug 19 00:28:10 devstack sudo[116376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:11 devstack sudo[116376]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-d74e920e-5484-49a9-b19a-fe6d3fc19739" returned: 0 in 0.240s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Lock "cinder-quobyte-d74e920e-5484-49a9-b19a-fe6d3fc19739" released by "delete_volume" :: held 0.639s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Created reservations ['54597a15-5919-42e7-84ea-cfbd8c1bb5fb', 'b9547e3c-dccf-466f-a75a-98534e034a67', '739248b1-e702-4a69-98d7-57ec0a5bf9d6', 'f6c6b179-b865-4232-bc3c-7d30709ec454'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:11 devstack sudo[116379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:28:11 devstack sudo[116379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:11 devstack sudo[116379]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.240s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:28:11 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Deleted volume successfully. Aug 19 00:28:11 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4eac9978-e2fe-49ec-8b3b-c9009d2ae695 tempest-ProjectMemberTests-237211261 None] Lock "cinder-d74e920e-5484-49a9-b19a-fe6d3fc19739-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:13 devstack sudo[116383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:28:13 devstack sudo[116383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:13 devstack sudo[116383]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.243s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:28:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 19 00:28:21 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=19,cinder:INSERT=9,cinder:UPDATE=34 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:28:21 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=4 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Flow 'volume_create_manager' (108426da-e682-4c9b-87cb-94c76e1cd1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9c16cd-83ce-4f4d-ad70-b953d5dcdd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9c16cd-83ce-4f4d-ad70-b953d5dcdd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1699073262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a464ab4-b60c-464a-b95b-556f8967c4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdb50403a7c4174870975ad6eece814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:28:32Z,use_quota=True,user_id='de7d381a4b6d488780d92ffa6719d595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f9b1ad-560b-4a29-8023-ab764760d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f9b1ad-560b-4a29-8023-ab764760d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7f3eab-e4fd-4f80-a127-1991120d5d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7f3eab-e4fd-4f80-a127-1991120d5d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a464ab4-b60c-464a-b95b-556f8967c4fd', 'volume_name': 'volume-7a464ab4-b60c-464a-b95b-556f8967c4fd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f09077d-5fd4-4e64-a12d-06b95d8778a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f09077d-5fd4-4e64-a12d-06b95d8778a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af984ef7-cc3d-4d7e-be98-9eb958c0bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:31 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Volume 7a464ab4-b60c-464a-b95b-556f8967c4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a464ab4-b60c-464a-b95b-556f8967c4fd', 'volume_size': 1} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1699073262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a464ab4-b60c-464a-b95b-556f8967c4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdb50403a7c4174870975ad6eece814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:28:32Z,use_quota=True,user_id='de7d381a4b6d488780d92ffa6719d595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)}" {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Creating volume 7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:28:31 devstack cinder-volume[94243]: INFO cinder.volume.drivers.remotefs [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] casted to osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 Aug 19 00:28:31 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd 1073741824 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:31 devstack sudo[116433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd 1073741824 Aug 19 00:28:31 devstack sudo[116433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:32 devstack sudo[116433]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd 1073741824" returned: 0 in 0.393s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:32 devstack sudo[116439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd Aug 19 00:28:32 devstack sudo[116439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:32 devstack sudo[116439]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd" returned: 0 in 0.246s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'} {{(pid=94243) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af984ef7-cc3d-4d7e-be98-9eb958c0bc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a464ab4-b60c-464a-b95b-556f8967c4fd', 'volume_size': 1}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a8aa6f-3dbb-45da-83b0-99aeec8fb678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:32 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Volume volume-7a464ab4-b60c-464a-b95b-556f8967c4fd (7a464ab4-b60c-464a-b95b-556f8967c4fd): created successfully Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a8aa6f-3dbb-45da-83b0-99aeec8fb678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Flow 'volume_create_manager' (108426da-e682-4c9b-87cb-94c76e1cd1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:28:32 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-8e44b3ef-787f-4e75-a5b1-5cf38e381ff3 tempest-SnapshotDependencyTests-60186601 None] Created volume successfully. Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:32 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Creating offline snapshot a6d1bead-d1b5-41ef-9584-f926eddb5ddb of volume 7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 19 00:28:33 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a94fa5f-cca7-4b7b-81b5-6a1e39ea167e]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:33 devstack sudo[116442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd Aug 19 00:28:33 devstack sudo[116442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:33 devstack sudo[116442]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd" returned: 0 in 0.349s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb 1G {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:33 devstack sudo[116447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb 1G Aug 19 00:28:33 devstack sudo[116447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:33 devstack sudo[116447]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb 1G" returned: 0 in 0.372s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:33 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a464ab4-b60c-464a-b95b-556f8967c4fd -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:33 devstack sudo[116453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a464ab4-b60c-464a-b95b-556f8967c4fd -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb Aug 19 00:28:33 devstack sudo[116453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:34 devstack sudo[116453]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a464ab4-b60c-464a-b95b-556f8967c4fd -F qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb" returned: 0 in 0.282s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:34 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb is being set with open permissions: ugo+rw Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:34 devstack sudo[116458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb Aug 19 00:28:34 devstack sudo[116458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:34 devstack sudo[116458]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb" returned: 0 in 0.239s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:34 devstack sudo[116461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info Aug 19 00:28:34 devstack sudo[116461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:34 devstack sudo[116461]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info" returned: 0 in 0.239s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:34 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info is being set with open permissions: ugo+rw Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:34 devstack sudo[116464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info Aug 19 00:28:34 devstack sudo[116464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:34 devstack sudo[116464]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.info" returned: 0 in 0.241s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:34 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:34 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4f135c6e-281a-4d57-8046-e4f85d0affdf tempest-SnapshotDependencyTests-60186601 None] Create snapshot completed successfully Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94243) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Flow 'volume_create_manager' (e283c7fd-32d8-4542-84ba-47f19e3fc269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a07b9b-431f-4200-9b89-ec65137693df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a07b9b-431f-4200-9b89-ec65137693df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-18T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bdb50403a7c4174870975ad6eece814',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-18T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6d1bead-d1b5-41ef-9584-f926eddb5ddb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-18T22:28:36Z,use_quota=True,user_id='de7d381a4b6d488780d92ffa6719d595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f00374-c924-463b-b7f3-58ff3c0a3cbf),volume_type_id=98f00374-c924-463b-b7f3-58ff3c0a3cbf)' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cccde9-7a9d-45a6-ae86-e6b1366f82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cccde9-7a9d-45a6-ae86-e6b1366f82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b166df8-7202-45ca-810a-636296b2ffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b166df8-7202-45ca-810a-636296b2ffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f', 'volume_name': 'volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f', 'volume_size': 1, 'snapshot_id': 'a6d1bead-d1b5-41ef-9584-f926eddb5ddb'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62c665b-a3c0-4848-9f34-6ef392545385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62c665b-a3c0-4848-9f34-6ef392545385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b8ad32-75d8-40bd-a05e-17ebb34c4eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:35 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Volume 286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f', 'volume_size': 1, 'snapshot_id': 'a6d1bead-d1b5-41ef-9584-f926eddb5ddb'} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-quobyte-a6d1bead-d1b5-41ef-9584-f926eddb5ddb-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" by "_create_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-a6d1bead-d1b5-41ef-9584-f926eddb5ddb-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Creating volume 286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f from snapshot a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Selected osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768 as target Quobyte volume. {{(pid=94243) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-quobyte-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" by "_copy_volume_from_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] snapshot: a6d1bead-d1b5-41ef-9584-f926eddb5ddb, volume: 286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f, {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c531b81-a093-41c6-a261-146a68999843]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:35 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:35 devstack sudo[116467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb Aug 19 00:28:35 devstack sudo[116467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:36 devstack sudo[116467]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb" returned: 0 in 0.346s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a464ab4-b60c-464a-b95b-556f8967c4fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9261700-5868-4ddb-8285-5f03881b4c5f]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:36 devstack sudo[116472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd Aug 19 00:28:36 devstack sudo[116472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:36 devstack sudo[116472]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd" returned: 0 in 0.344s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] will copy from snapshot at /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Creating direct copy from snapshot {{(pid=94243) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG cinder.utils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Path /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f not found in is_blk_device check {{(pid=94243) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 19 00:28:36 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:36 devstack sudo[116477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f Aug 19 00:28:36 devstack sudo[116477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:40 devstack sudo[116477]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" returned: 0 in 4.055s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.image.image_utils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Image conversion details: src /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f {{(pid=94243) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 19 00:28:40 devstack cinder-volume[94243]: INFO cinder.image.image_utils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Converted 1024.00 MB image at 252.42 MB/s Aug 19 00:28:40 devstack cinder-volume[94243]: WARNING cinder.volume.drivers.remotefs [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f is being set with open permissions: ugo+rw Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:40 devstack sudo[116490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f Aug 19 00:28:40 devstack sudo[116490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:40 devstack sudo[116490]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" returned: 0 in 0.240s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" released by "_copy_volume_from_snapshot" :: held 5.059s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-a6d1bead-d1b5-41ef-9584-f926eddb5ddb-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" released by "_create_volume_from_snapshot" :: held 5.119s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.133s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b8ad32-75d8-40bd-a05e-17ebb34c4eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f', 'volume_size': 1, 'snapshot_id': 'a6d1bead-d1b5-41ef-9584-f926eddb5ddb'}' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10651b68-84a7-40fd-88e8-19227dfeab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 19 00:28:40 devstack cinder-volume[94243]: INFO cinder.volume.flows.manager.create_volume [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Volume volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f (286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f): created successfully Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10651b68-84a7-40fd-88e8-19227dfeab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94243) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 19 00:28:40 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Flow 'volume_create_manager' (e283c7fd-32d8-4542-84ba-47f19e3fc269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94243) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 19 00:28:40 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-e1461252-f884-4b82-aba2-7bf6a937fd56 tempest-SnapshotDependencyTests-60186601 None] Created volume successfully. Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-a6d1bead-d1b5-41ef-9584-f926eddb5ddb-delete_snapshot" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-a6d1bead-d1b5-41ef-9584-f926eddb5ddb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-quobyte-7a464ab4-b60c-464a-b95b-556f8967c4fd" by "delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-7a464ab4-b60c-464a-b95b-556f8967c4fd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-quobyte-a6d1bead-d1b5-41ef-9584-f926eddb5ddb" by "_delete_snapshot" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-a6d1bead-d1b5-41ef-9584-f926eddb5ddb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Deleting offline snapshot a6d1bead-d1b5-41ef-9584-f926eddb5ddb of volume 7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] snapshot_file for this snap is: volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5cfda6-0ece-43ca-9a06-26de7a5001f8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:41 devstack sudo[116493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb Aug 19 00:28:41 devstack sudo[116493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:41 devstack sudo[116493]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb" returned: 0 in 0.342s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.remotefs [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a464ab4-b60c-464a-b95b-556f8967c4fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94243) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff7aeb-53ca-4834-b366-930d1e06a895]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:41 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:41 devstack sudo[116498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd Aug 19 00:28:41 devstack sudo[116498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:42 devstack sudo[116498]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd" returned: 0 in 0.517s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:42 devstack sudo[116505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb Aug 19 00:28:42 devstack sudo[116505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:42 devstack sudo[116505]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb" returned: 0 in 0.324s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:42 devstack sudo[116510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb Aug 19 00:28:42 devstack sudo[116510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:42 devstack sudo[116510]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd.a6d1bead-d1b5-41ef-9584-f926eddb5ddb" returned: 0 in 0.234s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-a6d1bead-d1b5-41ef-9584-f926eddb5ddb" released by "_delete_snapshot" :: held 1.507s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-7a464ab4-b60c-464a-b95b-556f8967c4fd" released by "delete_snapshot" :: held 1.528s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Created reservations ['251ed9fe-3a5e-469d-b3c7-93d637f69415', '81de897e-5eeb-4bb4-a50b-dd6d00b2f5d5', '46a8f5be-dce3-4332-8b0d-e3d15b70efc8', 'daa28f20-3970-48cd-801c-e41b15214c65'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:42 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Delete snapshot completed successfully. Aug 19 00:28:42 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-5a1d750e-b272-4385-a8c9-bd345b96b214 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-a6d1bead-d1b5-41ef-9584-f926eddb5ddb-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-7a464ab4-b60c-464a-b95b-556f8967c4fd-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-7a464ab4-b60c-464a-b95b-556f8967c4fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-quobyte-7a464ab4-b60c-464a-b95b-556f8967c4fd" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-7a464ab4-b60c-464a-b95b-556f8967c4fd" acquired by "delete_volume" :: waited 0.014s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1241f0-9077-4bb8-8fbf-a3fca42ed020]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:43 devstack sudo[116513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd Aug 19 00:28:43 devstack sudo[116513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:43 devstack sudo[116513]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd" returned: 0 in 0.356s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:43 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:43 devstack sudo[116518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd Aug 19 00:28:43 devstack sudo[116518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:43 devstack sudo[116518]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-7a464ab4-b60c-464a-b95b-556f8967c4fd" returned: 0 in 0.238s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-7a464ab4-b60c-464a-b95b-556f8967c4fd" released by "delete_volume" :: held 0.647s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Created reservations ['f1e29555-b37b-4346-b78a-9feed6bc1d92', '30b594e8-0b14-4941-8cbe-e92ef4f86b5e', '1f909209-c906-490c-b8dd-c430af258c19', '5b9734ac-86ad-40ca-960c-0c06d95f3613'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:44 devstack sudo[116521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:28:44 devstack sudo[116521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:44 devstack sudo[116521]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.248s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:28:44 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Deleted volume successfully. Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-4fd8db92-6a20-417d-9eaf-3d55dfe8955d tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-7a464ab4-b60c-464a-b95b-556f8967c4fd-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f-delete_volume" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "cinder-quobyte-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" by "delete_volume" {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" acquired by "delete_volume" :: waited 0.013s {{(pid=94243) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo.privsep.daemon [-] privsep: reply[e725f1d5-d16c-46c5-9956-9c502f5311f8]: (4, 'qcow2') {{(pid=95892) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:44 devstack sudo[116524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f Aug 19 00:28:44 devstack sudo[116524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:44 devstack sudo[116524]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" returned: 0 in 0.347s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:44 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:44 devstack sudo[116529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f Aug 19 00:28:44 devstack sudo[116529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:45 devstack sudo[116529]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915/volume-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" returned: 0 in 0.249s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-quobyte-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f" released by "delete_volume" :: held 0.632s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG cinder.quota [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Created reservations ['5ec8a126-14ac-4519-af2e-c5bf51fb4a9a', 'efc59928-b09e-408d-9238-e8be821dbdb6', '880e7421-0f11-48c1-a32f-63fb273bfd3d', 'd6a38e95-50c8-4f5e-86ef-cb65db07eaed'] {{(pid=94243) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:28:45 devstack sudo[116532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:28:45 devstack sudo[116532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:28:45 devstack sudo[116532]: pam_unix(sudo:session): session closed for user root Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.236s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:28:45 devstack cinder-volume[94243]: INFO cinder.volume.manager [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Deleted volume successfully. Aug 19 00:28:45 devstack cinder-volume[94243]: DEBUG cinder.coordination [None req-fab09474-997e-43af-852a-1ad22d7bd648 tempest-SnapshotDependencyTests-60186601 None] Lock "cinder-286bd7b7-daa0-40fb-a308-aa8c4d8c9b5f-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=94243) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 19 00:28:55 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:INSERT=8 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:28:55 devstack cinder-volume[94243]: DEBUG dbcounter [-] [94243] Writing DB stats cinder:UPDATE=30,cinder:SELECT=24,cinder:DELETE=5,cinder:INSERT=7 {{(pid=94243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768': None} {{(pid=94243) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG cinder.volume.drivers.quobyte [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5071a2d8-17f3-4203-8b55-1490ff87e768'] {{(pid=94243) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.lockutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94243) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 19 00:29:13 devstack sudo[116792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915 Aug 19 00:29:13 devstack sudo[116792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 19 00:29:13 devstack sudo[116792]: pam_unix(sudo:session): session closed for user root Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_concurrency.processutils [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/506f1336c809308a5383c5919b81a915" returned: 0 in 0.240s {{(pid=94243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG cinder.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Notifying Schedulers of capabilities ... {{(pid=94243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG oslo_service.periodic_task [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] Running periodic task VolumeManager._thread_info {{(pid=94243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread count: 28 {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 19 00:29:13 devstack cinder-volume[94243]: DEBUG cinder.volume.manager [None req-3fd4501b-ed0b-447a-85d2-7ea13006f9ca None None] thread info: [<_MainThread(MainThread, started 130197732536448)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}